I've asked that question myself before many times, and the next day I was not filled with regret for playing it safe or said,"Darn I sure wish I had gone to that event where I'd be triggered!" I think being in an environment rife with triggers is more isolating than playing it safe.
