Maem,
You know your son, and your situation, and are the only one who can or should decide what to do. It sounds like you have had a good bit of advice, from professionals. and have been doing a lot to help him.
Sometimes we need a lot of help.
If just throwing them out would fix all problems, there would not be many homeless. Mental illnesses make it a whole 'nother ball game.
Keep us posted, and know that we care. We are here for you.