I need him to come by the house every day and be with the kids, as he gets out of work hours before I do and we don't want them to be home alone.
My suggestion would be to establish a boundary that as soon as you get home he leaves. Your goal should be to be around him as little as possible.
Better yet, set a time that he should leave and then don't come home until after that time (for awhile) so that he doesn't have any contact with you. He has to miss you before he will come back. As AnotherStander points out, read all the LBS threads in Cadet's links above.
Me 51, Wife 44; Married 4; Together 10; HSD20, XWSD13, XWSS14, XWSS17 Kids Together D4, D1.52 W Moves Out: 03/16/17 W Files : 03/17/17 D Final: 10/23/17