When I bring up to him that he seems distant and isn't very affectionate towards me his answer his he's stressed. Just not sure how to handle that. I did tell him I need him to be more affectionate to me and I need him to show me I'm important to him like he used to.
Just another idea to consider: How about STOP. Stop bringing it up and just act as if.
I know, I know you want to sit down and talk it out and move back to where it was, but what if, just for a week, until you get to MC you don't make him address this when he seems to have answered you. I am pretty sure you will not get where you want to go if you sit him down, again. 180?
If you do not have time to have a date night and finances are tight, how about a date home? Like a picnic in bedroom? Call me corny but set up something and he may reward you.