Welcome to the Forum BBTaco!!
I personally haven't been in a similar situation, but it does sound quite a bit much for him to expect you to stick around after being missing for 3 weeks, has he done this before?
You'll find loads of support here on SR, It's great to have you here!!