How long have you guys been together?
What's more important to you? Relationship with your boyfriend, or your kids? If the latter, honestly, I would ditch him and find someone else who does like kids and can provide a positive role model. Right now, it sounds as though he could be permanently damaging your kids by teaching them this is how fathers are supposed to act.
Sorry if I was too harsh.