Emily, NOTHING you do or don't do will make a difference to anyone but you.
You take responsibility for what Emily does, where Emily goes and how Emily feels and allow him the room to take responsibility for what he does, goes and feels.
Please sit down...I don't want to shock you but--- believe it or not, you can play poker without him. You can go to Yoga AND enjoy it, without his consent. You can go to a gym, have lunch with friends, run around the block...do anything that doesn't involve breaking your marriage vows and FEEL GOOD ABOUT IT!
And those who care about you will encourage you to, as the army says, be all you can be.