My H had EA, and I thought it was a PA. I got an infection (turned out to be bacteria-like yeast) and I drilled him for days about lying and saying it was not a PA when it was because I had an STD. Turned out that the OB-GYN I went to see was new and filling in for my doctor and didn't know what he was looking at. My dr came back and straightened me out and what a fool I felt like. Felt good to know that H did not crack under the "proof" of a PA, though. What it did do was drive us very far apart for a long time.
What I'm saying is -it stinks to think it may be true, and I feel for you - but it's not worth pushing him away. Think long and hard now about your response to the sitch just in case it turns out to be true, you'll be prepared.