I have a bit of trouble offering advice to you gals whose H's are "nice" but LD. However, since you have very little to lose at this point you might try "climbing on his lap and pulling on his ears". See if you can convert his passive-aggression into straight-up aggression into sex.
"Tell me, what is it you plan to do with your one wild and precious life?" - Mary Oliver