It sounds as if the time away did your H some good!
Quote: I asked H where he was going and he said to --town where OW is from
I was thinking that your H doesn't lie to you when he's going to see OW; he tells you straight out...almost as if in a defiant manner. Why would he lie to you about the weekend?
Keep focusing on the good, on the positives, on the fact that he comes home to YOU!!