You want him to MISS you and the SMIPLER life before all this drama thats now unfolding.. you want that aching to come back in him now.. you can't do that if you are at your home at his beck and call... get OUT and cut yourself off for a while..
This thing about him worrying is EXACTLY why you need to STOP exposing yoruself from him and LEAVE... not just for an afternoon... get OUT move out.. for a week or so until he's calmed DOWN...
its not HEALTHLY for you to be tehre now and its NOT HELPING your MARRIAGE...