My go-to a lot of the time is "I'm sorry you feel that way".
I'm not apologizing FOR anything & also not taking any ownership of their feelings, but the person hearing it often feels apologized to based on how they interpret it. It gives me an easy way to end/walk away from the conversation.