Sorry I haven't been around much this weekend. I don't think I would be asking for keys or changing locks, I know how you feel but you don't want to look less attractive to him than the OW and doing this could be perceived as just being a plan "b@!*#" which you aren't and you certainly don't want to look like one.
You will really have to work on keeping your emotions in check as hard as it is, it is the one thing that will undo every ounce of good work that you put in. Maybe yoga or something like that is what would be good for you, do you have a community centre or such where you are or one nearby that runs classes such as those.
I know how hard it is to keep a lid on emotions, believe me I have been there and done that.