At one time when I quit drinking for 30 days (to prove I could do it, lol) I felt "more secure" having the booze in the house, even though I wasn't going to drink it. When I was ready to quit for good, I got rid of ALL of it.
Still, I've heard of a good many sober alcoholics who refused, on general principle, to throw out the booze. I think it's rare, but it does happen.