He is being manipulative. Trying to control you. To keep you down.If he knows the deposit money will help you to move on he is going to try to keep it. He can try all he wants ...you are entitled to half of the deposit at the very least. Are you on the lease with him? The landlord was right in refusing to give it to him. Stay strong.