I have found that swift, simple, short, and direct is the only way I can manage conversations like that whether in person, email, whatever. It was really hard for me to say those things openly, directly, and honestly at first. It actually felt scary but I felt better about myself when I did. It did become easier.