You will need a tall fence top. Deer can really jump, I've heard of them clearing 8' fence.
Have you tried any of the non-chemical deterrents? There are many on the web, not sure if any of them work. I'm sure it is a tough job, I'm guessing that the deer aren't really afraid of humans there.
Enjoy the hot tub.