It really depends on the situation. I've used many of the same reasons as freshstart57: No thanks, medication, tired enough already, not feeling well, etc.
People don't usually push or even notice. It's always a much bigger deal for me than it is for them. Dealing with it does get easier and 'smoother' over time.