I would not argue with him, but still stick to my guns. If he wants to go out with you...let him now and then. Tell him you are available on a certain night, if he can find a sitter for the kids...you'd love to let him take you out.

Put the ball in his court.

I am responsible for my own happiness.