I think it might! Even if you don't do anything about it for now.

I don't like the idea of poking your H with a stick right now, before you have anyplace to go. In a way, I think that you knowing, and him not knowing that you do, puts you in a good place. If he finds out you know, he is going to hide everything, as fast as he can.