Sorry things aren't progressing as much as you want them to at this point. I am sure that even with "no expectations" being the guideline, it is hard not to have any when he says ILY and I'm Sorry.
My D(2 in three weeks!) is asking "where daddy go?" now, that is new. So I understand wishing for you both to be under one roof.
Try not to get discouraged. He IS staying with you this week, and he did say he was sorry. So things are progressing, bit by bit.....
I know. Go get a latte--you'll feel better OK so not even Starbucks helps when you feel disappointed, but it was worth a shot....