Hi sobered -
My first reaction was pretty much like the others..... When you say "he might snap," it doesn't sound good. How long have you been sober? Drinking enabled me to tolerate things I normally wouldn't. Could it be that you're realizing this isn't really a healthy relationship?
You can get counseling to help you deal with the loneliness if you decide to move past this relationship. A drink will only add to your depression/anxiety. If you can't face a change in the immediate future, you can still take baby steps in that direction.
There really are options, sobered. You deserve to be happy.:ghug3