My friend, everything you report about this incident makes my skin crawl. The manipulation, gaslighting, emotional abuse -- it's not just "out of line". It's unacceptable.
And yes, it is crazy-making. It is crazy-making on purpose, so that you will minimize, deny, and feel too confused to see that he is extremely controlling and manipulative. None of what you describe is healthy, and none of it is "love."