I'm sorry you hurt. However, your shooting yourself in the foot by responding from an emotional place.
If you can't say anything nice, don't say anything at all.
You don't HAVE to respond to him if you don't want to. When you choose to respond though, it needs to be from a place where you're not reacting from pain/anger.