I know exactly what you mean. In my opinion, if you want him there he should be there. Your family can be mad all they want, but in the end they have to understand that it is your decision, between you and your H.
And let's hope they don't judge you for this, but it will be hard, only because they care for you.
