Yes talk to your H and if he prefers you not to go, then he should talk to your FIL about it not you.

married 23 years
4 grown up kids