MamaKit, I know how hard this is--I have been through the same thing in the past.
Please try your best to not what-if and worry about what he is going to do. This keeps your stress level up--and doesn't change what his reaction will be.
Just resolve that you will handle it when that day comes. Don't allow him to rent space in your brain. You have done great so far--and will continue to do so!!!!