Rouky, Your h detached from you and the relationship at least 2 years before he dropped the bomb about not being happy, etc. So, he's had ample time to become a detached individual. You, on the other hand, are just starting the journey and are still on the emotional roller coaster.
When he says that it's never a give and take with you...tell him" I'm sorry you feel that way" and walk away. Don't take those type of comments personally. It's all about him, how he feels and yes, how he sees the situation for what it is. He made that statement to get under your skin because you are going away and he's not happy about it.
Rouky, just be yourself. The calmer you are around him, the better. Keep your voice calm and even and always look him in the eye. Trust me, in a few months, you will have mastered some of the art of detaching and you won't allow him to get under your skin as much.
Go and have some fun and don't allow his behavior and comments to ruin your weekend. He's not worth it right now.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.