I don't think he was planning on being with her because she has an affair partner. So he was planning on having some time to his self to reflect in light of the affair.
I get that, DLS, but then why be upset that she didn't spend time with him?
I think he get's upset about it because she made it a special time with the other guy, and even stretched it on further. It's almost as if she's pooping in his face and getting a huge laugh out of it.
