I think we all have a tendency, in situations like these, to put our feelings on the back burner. We think, well, I'll give him space (even if I don't feel right doing that), I'll let him come and go as he pleases (even if I don't like that), I'll not tell him what I want (even if what he's doing is hurting me)... we all do it. For me, I believed it was helping the situation.
Just because you gave him the "free" speech doesn't mean that you can't express how you feel about what he is doing. If want to know what his plans are just say "you are free to come and go as you please, but I would feel more comfortable if you gave me an idea of when you will be here and won't. You are still able to make any choice you want, I have no control over your actions, I would just feel better if I knew what your plans are." It will help if you really got a handle on how you felt - that way you could determine some boundaries...
Me: 34 H: 39 M: 7 yrs H A 12/05-8/07
If what you say surprises me, I must have been assuming something else was true. - M. Wheatley