WTBH, you are doing great!
I think having a couple of friends around at your daughter's party is a fabulous idea.
Not likely that your AH or his family will bother you if you have some good supportive friends or family members by your side.
Sending positive thoughts your way
Stay strong!