I also might advise not to invite your H, don't let him detract from your special day.
I know that when I recently had my 40th that I decided to leave my H out. Including him would have left me concerned about him, what he thought, pleasing him, blah blah blah.
As it was I got nothing from him, no card, no flowers, no nothing and this was my 40th mind you. He said he had no $, what a bunch of crap, the dollar store sells cards for 50 cents for goodness sakes. But all that would have required him thinking about someone besides himself for a change.
It's your turn. Have a great time and leave him out of the group celebration for now. If he does want to do something for your B'day make it the three of you or the two of you, not anything more than that.