Right now he should not be telling you what to do and neither should his mother.
The best way to make a clean break is to just make the break and don't get drawn into the drama anyone else wants to create.
I am glad you have your own meetings, it will help you find your balance again and become healthy enough to move forward.
Hugs