So, chl, has this been an issue before? You texting him and him being rude because
"you texted?"

Don't text. Obviously his response had nothing to do with the fact you texted, but that is mind reading, so let it go. If you feel this has been an issue and want to address it, you can simply say that his response was rude and uncalled for. If he would not like to be texted at certain times, just give you a heads up and you would be happy to comply.

This is iffy though, because there can be no hint of "geez you were an a$$hole in your voice"

But if this is a boundary for you, make it so smile