You have to do what feels right for you. If you feel uncomfortable w/your h around or he's popping in whenever he feels like it, then you will need to set boundaries.
As for the holidays, you will know what to do when the time comes. You've got little over a month before Thanksgiving is here. I wouldn't worry to much about making a decision now. A lot can happen between now and then.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.
