Yup, that's the best angle to take... even in conversations with him "This is more trouble for US, but LESS trouble for the kids" etc...

If he refuses then its obvious he is willing to allow his children to be inconvenienced just so he maintains his comfortable living... and if others are there to see him take that position it just exposes his behaviour all the more...

I suspect if its addressed with too many people there he will criticize you in private for bullying him...

well, he does the same thing... just tell him "this is MORE inconveient for ME, but it IS better for these kids"