You can't change what happened last week, but it obviously makes you uncomfortable. Do not allow him or anyone to do that again. I'm glad you live on your own, stick here if you are feeling lonely, don't contact him, and don't ever let someone force you to do something that makes you uncomfortable.
Do y have plans to stay sober tomorrow? Do you need to worry about him contacting you? If so, come up with a plan to let him know you do not want to see him.