To be honest I fully understand and I once did.
One day I had had enough (not drug related) but of his affair and her efforts to contact him still.
One day, I lost patience.
I walked out and left him and the baby together.
He was meant to be working and he had to ring and say there was a problem at home and he could not go to work.
I went for a long drive.
I did some window shopping.
I parked up bought some lunch and a magazine.
I had a sleep.
When I went back he saw how hard it was being at home with a baby when you are worrying about where someone is or what someone is up to.
It made him a bit more considerate. Not much, but a bit.
But yes, I totally get you.