weezer, you're very clear-eyed about him manipulating you, so that's good. Now you can feel sorry for him because you've already told him what he has to do to before you can talk. He's not doing it right? Manipulating you is the line of least resistance.
As for how you handle it, here's a suggestion. Start thinking like him. If you were going to manipulate you, what would you say in a text? Write out a few examples and shout 'Bingo!' when they arrive.