I agree, you didn't sacrifice your boundaries in a possible moment of weakness. Its tough, I know, but he's going to have to make a choice right. Let him think about what he's actually losing.
The stronger you are, the more you stand for your needs, respect, and less power you give him over you.
