My H and I used to play insult each other, and say things like "I should have run away from you the day I met you." It took us years to realize that saying things like that wasn't funny. It was mean. We don't do it anymore. You do need to tell him it isn't funny or endearing. I think he thinks it is.