That is okay. Trust me he will notice. There is the saying "if you love something set it free. if it comes back it is yours. if it doesn't it was never yours to begin with." He is already yours, through your bonds of marriage. Therefore, you just need to let him go through whatever it is he is going to go through, and realize that it does not have anything to do with you. But the outcome may potentially have EVERYTHING to do with how you handle this. You will act in ways that will feel utterly wrong. But trust me, they work.
Im still standin better than I ever did looking like a true survivor feeling like a little kid Im still standin after all this time and Im picking up the pieces of my life without you on my mind..