If you are coming to terms with and "beating" your controlling issues... then he will only know this is true if you TELL him NOTHING... either way...

If he ASKS you if he should move out, you'd answer in a way that shows that is up to him...

If you WANT him to move out... then let him know you would like him to move out, but you won't force him out...

It's not much different than inviting people for tea... you put the question / offer out there and the guests can choose what they want...