A friend of mine recently went through a similar situation with her H, although he did not have an A. A woman was hitting on him at work over the course of many months, even though she was married. My friend told her H that he should tell her to back off. He did but she persisted. Then my friend said that H had to get a new job if he couldn't keep the situation under control. And he did. But that's what can happen when both partners are committed to preserving the relationship, value their family, and are not in an A or MLC.
However, if your relationship is in a vulnerable place, then making demands like changing jobs might backfire.
M: 43 H: 39 D: 14 Married 15 Together 16 BD: 6/2014 S: 8/2014 OW revealed 10/2014 Instigated dissolution 12/2014, in progress So over it!