I understand your frustration, but you are still trying to accommodate him. If you truly want a divorce, then file. If he doesn't qualify for a refinance of the house, then that's too bad. Just sell it and divide the profit, if any, or have him buy you out and be done with it.
Your post was all about what HE said during this mediation. What did the mediator say?