One thing I am sure of, this was not a spur-of-the-moment thing for H. He planned the whole weekend around it, or at least around the idea of seeing what the chemistry *could* be like.
A man who was happy with his sex life would not do all that, and risk getting the whole separation thing out of whack, just to see if he could "have" you. Something is amiss in OW-ville.
Maybe something went wrong between them because of the new job. Maybe she is pressuring him to file for D. Maybe she was pressuring him to bring the kids to the beach, knowing that would start a conflict, to see what side he would come down on.
Maybe he is just having second thoughts. And before dumping OW he wanted to be sure that the path home was smooth.
Sorry, I know that you already spend too much time wondering what he is thinking, and I don't see any need for you to find out why his thinking has changed. But I think it has.
My point is, it would be a shame to tell him it was a f-buddy moment when he was about to tell you he wanted to come home.