Perhaps if you could ask your therapist to chat to them, on the phone if not in person and explain how important it is for you to concentrate on recovery for now?
It's not easy for people to understand, if they've not been through it
They assume once you've stopped, that's it.