Hoping it's not too late

[MrBond]

Next time you talk to him, try to avoid saying things like "letting him go". No one wants to be "owned" by someone.

And this part..."I felt like he needed to take a few days break. "

You don't control the situation, but it shows you're trying to. Time and time again you do this. If he is to come back to you, he has to do in under HIS terms. NOT yours.