He's using you Tulo. He's only interested in sex and that seems to be the only thing he wants to get in touch wit you about. He wouldn't treat you that way if he had caring feelings for you.
Sorry, but it's a no brainer for me - he has to go. He's getting involved with other women (several) and isn't hiding it. He sounds like a rat, smells like a rat, therefore he is a rat. If he's doing this to you, who else is he doing it to.
Last thing, get a sexual health check up.
M 45 W 52 SD22 S9 D8 BD 6 April 2015 Not living together 4 Dec 2015