If you can deny him entry LEGALLY then I would have locks changed by now already...
I usualy reccomend you protect hte family FIRST and THEN expose the affair... nto the other way around...
Ensure you and the family are safe and THEN reveal to whomever may put pressure on your H to end the A... if you expose and don't have a protection plan in place you are a sitting duck...
The response is usually a verbal barrage of abuse... but it COULD get worse for a small %... Your H isnt' likley the violent type, but I HAVE to warn you to be on the safe side of this...
Change the locks if you legally can do this... if he doens't live there and you legally can change the locks then I would have done this asap... JUst to make the point alone, never mind the exposure
To my mind if my spouse doesnt' live in my home they should NOT have a functional key to the home either
But again you need to check with the law to be sure
