Sounds like the beginning of Withdrawal, to me, when they go deep into themselves and stop nearly all those interactions with you. On the other hand, since he's still living with the OW, it may be a bit early for that.
I hope you and your children have fun things planned for the weekend!