NTE - then (sorry to be a tough beeotch but....) you will continue to spin your wheels and search for someone else to "blame" for your mistfortune, all the while being sex starved.
Which is worse? The state you are in, or the state you would be in if you made the ultimatum, or the state you will be in if you end up divorced?
