I agree that this isn't something to pursue too heavily. If anything, just let him know that dinner will be ready at 6:30pm every day unless he calls you and lets you know he'll be late. If he's there after 6:30, he can reheat the food himself.
I don't think they were being jerks, they were just being men. Men and women see things differently.
