I agree that you have a huge alliance in the family and I would not jeopardize that. Whether or not to be there in person is up to you, I would def reach out and keep close connections though.
If I had that connection w/ MIL years ago- my sitch may be diff.
Good for you about leaving- I would stay DIM/DARK and let him wonder- experience some loss