Well keep listening to your heart sounds like it is leading you in a better direction than your mind right now. Best wishes that you find the strength to quit.
p.s. hope I don't sound harsh but there is never "the best time to quit" but I think you already know that.