Maybe start with screening his calls and waiting until the next day to get back with him.
It will give you time to mentally arm yourself and by then any "emergency" may have found a new host.
Setting a clear boundary and sticking to it would be the ultimate goal.