I'll add my voice to the chorus. The only thing that matters here is what YOU want. Are you living the life you want to live with him in the house? If not, then maybe you should consider a change in the situation. Not because it's enabling, not because it *might* be his bottom, but because it's YOUR life and you have the option to live it the way you want.
L