That's awful bookmaven, sorry you had that experience. There must have been someone in the crowd who is similar and afraid to say anything. Actually that sounds really ignorant and would they accuse someone who took something for their physical health like a blood pressure med or something? Not likely.
Don't drive yourself nuts about it, they are wrong.