Kmber2010, I truly understand your situation with this woman. You can very nicely tell her, that she is a nice woman, and you mean no harm to her. Every time she calls on you, just tell her your busy, and after a while she will get the hint.
When I cleaned up, I realized that I didn't have much in common with my friends who were still getting high. Sometimes we just have to move forward. If you feel she is a stalker, she probably is. So be careful, and kind of let her down easy so she doesn't harm you in any way. She sounds like a nut job, but it's not for me to judge.
I don't even know the woman. However, with the boss calling and all that, sounds like she is a trouble maker. Follow your instinct, and break away for good.
Let us know how things turn out.