Are the visits court mandated? If not, you may want to consider telling him that you and dear daughter will leave if he cannot keep a civil tongue in his head--then follow through as needed. You can reschedule a visit when he calms down. There is no need for you or your daughter to have to go through that.
Hugs and prayers, HG