If lease is in your name and you are not married to a guy - I guarantee there is a way to evict him legally.
I know there is a way to do that while divorcing - I.e file for sole occupancy on grounds of difficult living situation, not that hard to do if spouse is drinking/not working and children are involved.
+1 on getting legal advice.