I agree, it's his money. How he spends it is none of your business. If you agreed to repay him when he gave it to you, then that's what you need to do.
It may be time to tell him to take that money and put it toward his new away-from-you apartment if you two are currently living together.