Wow, that's PA behavior... He expects that you do you own moving with 3 small kids and a full time job! May be you should give him a nice ultimatum, "if we are getting too busy may be we should reconsider hiring a company to move, remember also I had some heart issues and it's to my best interest to be careful, so unless you do all the packing I am not sure I can help/do it that time.
Me 52+ WH 57+ Married 20 + Piecing since 2016 (ready to give up...)
