Chicory - please know you are doing the most loving for your son. None of us will live forever and he really needs to be able to take care of himself sooner or later. Hopefully sooner, for both of his and your sake.
P.S. Guilt and shame are pointless emotions! Give them to God and let them go. That took a lot of practice for me!!