If they boys want him to come, could they ask him?
I think it would be nice for the kids to have a family day, if you two can get through it without any sort of snipping or fighting or anything. Of course, this is from the gal who hangs out on a daily basis with her xh...