He’s accusing you of going out with another man and desperately wants to know more. This is a good thing. He’s worried he might be losing you. I would do NOTHING to stop him thinking this.
This is how you DB. Let him think whatever his imagination comes up with.