Your H is going to think what he's going to think. The truth is you DIDN'T ask H's mom to speak to him. He's a WAH so of course he's going to blame all of the consequences of his actions on you.
You stay within that bubble. You are posting about it here so you at least know it's coming. Now you get to decide how to respond to it when it happens. Instead of being wounded and outraged that he could be so unfair, you can decide to shrug, continue on with your day, and ask him later if he'd like to join you at the gym (or whatever). Don't defend yourself, don't be drawn into an argument. Just let it go and focus on being the best T0 you can be.
To me this is a lot more detached than trying to control everyone near H because you are in fear of how his warped mind will react.
Make sense? Hang in there!
Me:38 XW:38 T:11 years M:8 years Kids: S14, D11, D7 BD/Move out day: 6/17/14, D final Dec 15