Well, CV, I think the answer to your final question is both simple and complicated. Guess that makes it complicated in the end... hahahahaha.
Again, there are 3 entities here... you, your H and your M. You must preserve individual rights, but always also protect the "greater good," which would be the marriage. I just don't see how going floating with you is trampling on your H's individual rights. If, say, he would be in pain or had some fear towards it, then I would say it's best he protects his individual rights. But if he's just saying no just because he doesn't feel like it, then we have a case where he's ignoring the needs of the M... I'm not sure you are pushing your will necessarily by wanting to go floating... like you said, if it were simply about your will, you'd go yourself. But I think you have a mind towards the entity of M when you ask him to join you and the need of the M to have bonding time. When the answer is ALWAYS no about what you want to do, well, now we are back to trampling on one's individual rights. In this case, yours.
See, I don't blame you. In fact, I agree with you. I just think sometimes these things do need to be argued. Certainly more than I ever did. I can't sit here and say he never did what I wanted because I know while that is true, I did nothing to point that out to him. I did nothing to explain the importance. And by not doing that, I didn't have a mind towards the M either. It was all about me and my hurt feelings and fear of further rejection. At no point, until now, was I thinking well I need to talk with him further about this because this is seriously affecting the M. I never gave him a fair shot or the M because I was too busy being hurt.