I agree you're being taken advantage of, with him coming home after dinner tanked. I'm glad you're able to come here to vent as talking to him wouldn't get you anywhere.
Don't focus on the little arguments hh, it's the big picture that's driving you crazy. You're doing a great job with your kids, so be proud of yourself.