As for your work mate, I would just ask this person, what is your problem with me. I am one of these people that wants to resolve an issue and I cannot improve a situation unless I understand what the problem is. You do not have to accept this other persons treatment of you. Sometimes confrontation is the only solution.
Your husband, I would do as Tally suggests. Just walk away.