If you had a seizure, you should definitely get it checked out. You don't want to just assume it was from using or withdrawing. There could be something else going on.
That said, it should be pretty easy to make sure you never take benzos again. I don't know your whole story, but if you tell the doctor you have benzodiazepine use disorder and you don't want to take any, they should respect that. You don't even have to say that, you can just simply decline a prescription saying it's not a treatment plan you want. And if that doesn't work, you can just not fill a prescription if you can't avoid getting one. I do agree with you though that avoiding them is probably going to make you happier than taking them.