In early recovery, I made it a point to stay out of any situation where that question would even come up...
Let your husband entertain clients alone for a while. When your recovery is stronger, you can join him. You will find then that it's not the issue you are making it now.