Take the drugs out of this.
Lots of people have great difficulty with accepting responsibility for themselves and project it all in emotional outbursts on the people closest to them, especially once the relationship honeymoon period is over.
If you had no knowledge of his history with drugs, would his current behaviors be more acceptable to you?