No, you're not crazy. Whether or not he's an alkie is beside the point. His drinking is causing trouble and it seems he's choosing drinking over you.
Make boundaries of what you will and won't tolerate, and stick to them.
I'm sorry you're in this situation, but want to welcome you to the family.