I'd recommend going on the planned vacation. I was in a similar situation and we went on a cruise. It didn't change things, but our sons had a ton of fun and that was a very good thing. I'd do the same thing over again.
I should add, I was at my best behavior. I validated my wife and avoided conflict. It made for a pleasant cruise and I felt rested afterward.
