Well, it sounds to me like you are sending him mixed messages. It doesn't sound like you really know yet what behavior you will or won't tolerate. I don't mean to sound all doom and gloom, but... You left him for a reason. Has anything really changed? Is it really a good idea for him to come back if you still aren't getting along, and if you still aren't really sure what you want?