There wasn't anything wrong with your text Ali! There is no way he wasn't saying what he said in an amused way.
Don't worry that he went home. That's a good place for him to find his center. He needs that before he will really be ready to have a full relationship with you. You should carry a sock around to stuff in the the mouths of all those negative folks!