Boundaries are so important and good that you are making them.
On the flipside, if you want to maintain this relationship, what is the communication style.
If he says to you, lunch today? and your reply is - why would you want to go to lunch etc - that's a guaranteed argument. It's bait. I totally get you are angry, that's a normal reaction, however if you want to fix this relationship if you come at it this way all you two will ever do is fight.
I asked him why we cannot talk like civilized human beings.
You are hurt and you are angry and you are accusing him of being in denial and not having remorse for his behaviour. Again, that's not going to get you the result you desire. If you really want to communicate then you are going to have to sit down and calmly discuss it. If it gets too heated you both need to perhaps walk away for a few minutes.
I'm not saying you are wrong or that you don't have a right to be upset (just want to make sure you know) but this communication style will never work.
Really with a boundary of this type, if you want to explain it to him you can (you kind of already have, but a calm conversation about where you stand may be in order, to keep him from questioning you every time). Then that is just the way it is, no need for a heated discussion each time this happens and it will keep happening unless he decides to change the way he approaches things (which is really tough and also unlikely to happen in any quick fashion if at all).
I do wish you luck with it though.