Of course it's cheating.

The worst part about it is the double life element.

The man has deep psychological problems, Lass.
You don't go through multiple wives and girlfriends, denying them all sex and claiming that it's their doing, unless there is something utterly broken about how you view your sexuality.

Big hugs, lady.