This is why I believe it's important to know if H is having an affair.
If there isn't OW then perhaps it's a good idea to change the dynamics and see what happens.
If H has OW then you are enabling his cake eating. Nothing will change because he is getting the best of both worlds--a good time with OW with no responsibilities and friendship with you with no responsibilities. You put yourself in limbo and then six months to a year later (or longer) wonder why you're still in the same place.
If you love somebody, set them free. http://tinyurl.com/2empx2g