Other than simply not answering the phone (which I did not mean to do this time), what else can I do to enforce my boundary that I don't want to be friends while he is with OW?
If he calls and gets chatty then just tell him you've got something to do and need to let him go.