Well, you've stated how you feel about him attending the party and now he's got something to mull over. I'm sorry you feel the way you do and I can't blame you, but I don't think he'll attend, especially in the frame of mind he's in. If he asks again, suggest that it might be best if he were to come home and be there w/your son since you may be getting home later than usual.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.