Abuse is not ok, drinking, like many things makes it easy to do inappropriate things. If you feel unsafe then it really is time for action, but you need to be honest with yourself or have a counselor help you make and objective choice.
Strength and wisdom to you!