How old is your AS? I suspect old enough to look after himself! if I were you I would tell him the true, don't hide your feelings, tell him how it is in a calm manner. Don't let yourself get worked up. This will not change him but it will get it off your chest.
Just remember, the more you do for him the less self esteem he will have.
Good luck.