Go.
You're assuming no one knows about his drinking. When my AH died, I was very surprised that the associates who only saw him on occasion were well aware he was an alcoholic.
You have so much going for you: a master's degree (!), you qualify for a loan (even if your current locale is not your dream) you realize homes in the area are "not that great for the price that is asked."
I do not know, nor do I want to, what "sexual hallucinations" are - fantasies? maybe? and he calls his son to chat about them?
The longer you stay, the more difficult it is to untangle your life from his. The father/son dynamic sounds a little sketchy.