Cathy - I think this is all good. H bringing up sex? Definitely good. Now, the biggest mistake I see women making at this point is asking for some kind of reassurance or commitment before they'll have sex. Don't do that - they can't think that straight yet. All they know is, they're fantasizing about sex with you and they're not sure why. Flirt with him. Tease him. Drive him to distraction so he'll HAVE to come over and sleep with you and be reminded how great it can be between the two of you. YOU become the OW he's having the exciting affair with.
It's good you got the chance to clear up what you actually said to him - I'm not surprised that what he heard doesn't match what you said - happens a lot, in fact that gap between what we mean to communicate and what our Ses hear is a big part of how we ended up here in the first place.
So maybe send him a short sexy email ("I'm wearing a new red thong from Victoria's Secret - just thought you'd want to know"). Then leave the ball in his court.