Sorry you're feeling this way. But you are only human.
There is only so much you can take.
Don't be so hard on yourself.
Who is the other one with bipolar, your wife?
From what I understand you live with 2 people who have a good excuse for behaving the way they do, and that is the way things are, but IMO that doesn't mean that you have to have it in control when you can't take it any more. As I said you're only human. You have every right to need and demand some peace and quiet for yourself.
I don't think you, (or anyone), are supposed to put up (and shut up) with things that are making you crazy.
You're not the only one accountable.
Take care