Why are you not comfortable with them going to his apartment? Has he asked for them to stay at his apartment? I would allow them to go. This would let you start to GAL and become mysterious a little. Right now you are a prisoner. He knows you can't go out but he can. What kind of life is that? Again this is for YOU. To save you and your self esteem