Buggirl,your sobriety needs to come first.If you feel at all worried about this party don't go,it is that simple.You can just say no,no explanation necessary.
It is not about what others think of you,it is about you protecting yourself.
If you decide to go,make sure you have an escape plan and remain vigilant.