feelingstuck,
amy wrote an excellent post just above mine here. it might be worth a second read.
it sounds, from your 2nd post, that he knew what the consequences would be if he ______ (whatever was "the next time"). so, he did, and you followed through with what you said would happen.
sooo.....if you cave in to his whiney, nice-guy pleas, it sorta blows your credibility with him, doesn't it?
this separation does not have to be forever, but i would urge you to stay strong, remember why you kicked him out in the first place, and examine whether anything has changed.