Well, we know what NOT to do, but its hard to DB. Its your only choice though, because no one wants to be around someone like our 'old' selves (begging pleading crying). The one boundary I have set if my H decides to move out is seeing other people. I told him it would be a MAJOR deal breaker. I think your husband knows this.
It seems he is getting pressure all around, from OW and from his guilt. And even though you aren't pursuing, he still probably feels pressure as well.
Wait it out, don't ask, just try to stay calm. SO hard, I know.