In my state, if you are receiving mail at an address, it is considered your home. Perhaps if you are staying somewhere while not listed as an occupant on the lease, it would be easier to get him out. You don't have to tell them that you have allowed him to stay there. Are you legally separated?
Since he has been violent, might be a good idea to have the police there when you arrive, so they can make it safer for you.