so, you've been paying for food, eating out, cigs, etc. and he gets some money and doesn't want to share it with you? and then gets nasty and defensive about it? and then changing stories about what he was going to do with the money.
i would look very hard at his behavior, in recovery or not.
it sounds as if he is using you.
and so, he gets some money, plans on using it on a trip that you don't want, and when this trip is over, are you expected to go on paying his way as his money will be spent?
if it was me, i would explain to him that you can't afford to pay his way any longer, as you don't have enough money for your own needs. and then stop giving him anything. and see if he still wants to spend time with you.
there's lots of activities that don't cost any money...taking a walk, working out, going to the library, browsing a gallery, hanging out at home, doing a project together.