It could be that you have been doing something different and he's trying to figure out why. The first thing that popped into his head is that you must be having an affair and yes, he's projecting a bit.
You may want to do a search and locate HRM134's postings. Her h never left home and she did an excellent job of living in the home w/him. Now mind you, he drove her a bit nuts, but the last time she posted, they were finally communicating better and things were moving along nicely.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.