He's manipulating you. Please, please don't minimize the abuse he perpetrated on you. If he'll do it once, he'll do it again. That is a promise. But, he didn't just do it one time, did he? He did it multiple times. THAT is how you know he won't change and if you start giving in, he's going to keep on manipulating you.
The very best thing you can do is go no contact. No phone calls, no texts, no emails, no nothing! It just doesn't sound like you are strong enough yet to be listening to his quacking. I really do fear for you, hon.