sometimes the ONLY solution is to walk away. far far away.
you mentioned you met him straight out of jail and acknowledge it was a red flag. yes a really really big one. and that he had been in trouble with drugs and jail all of his adult life. so what he is doing now is really just a continuum.....he's doing what he's always done. this behavior IS his baseline. and it's best just to leave him to it.
round up his stuff and get it out of your house.