Mystify, a few things...

First, what do you want? Do you want to possibly save your M with this man or are you ready to be done?

I understand you are upset, that is normal. Some of the things you said to your H appear to be in direct effort and intention to bring him back home and to the M, through the use of fear.

Did you intend to scare him into coming back by saying you wouldn't be his friend, you would move closer to your work and/or you might move back to Florida?

Do you understand that, even though your H came back, he is likely living right now in a state of fear and panic that you might take his son away from him.

If you are OK with that, it is your choice.

Still, I ask, do you expect him to be pleasant, after your threats of taking his son away?

You are a threat to him and he may not be very likely or willing to be pleasant with you, except he may try... again, because he's afraid of the threat.

You may suggest it is not an idle threat and you will. Either way, your H sees the threat and you are the enemy.

How do you think you might help change this dynamic around?

Did your H ever offer any reasons why he was unhappy in the M?