Often, if there isn't an actual affair, there's someone they have a crush on, or an internet "friend", or the like.
Often, there actually IS an affair, too. I thought MY H wasn't having an affair when I first came here - I was sure of it! Shows how little I knew!!!

Ellie