Is the hand holding and lap swinging over different from what you and H have done so far? That sounds positive to me; and great that it was fine for both of you.
I know what you mean about feeling independent and getting stronger. Do you think it might be worth trying something different in your sitch to see if it affects H's behaviour in any way? A 180 of some kind?
