If that is the case, then you need to make a change. You are not being fair to this man with whom you live. Besides, it isn't like you are unable to take the steps for a divorce, rather you are unwilling.
Time for you to take a risk. Sh*t or get off the pot.