My advice? Go with him and be happy he wanted to include you. Otherwise, let him go. You'll only make things worse if you try to keep him from his friends.