You are better than this. Saffie is right, it's just words. Head up high, rise above it and don't give him the satifaction of letting on you know (it is probably what he wants to justify his actions).
P.S. No 2 by 4 as we have all done it ... and felt betrayed afterwards.