Boundaries aren't what you are missing, its consequences.

What are you prepared to do if he IS with OW again?

Think really hard on that.

He may just be with OW to test your limits... children do that all the time...