Really, that is the only/best thing you can do. Let him work on his relationship with the kids and see what happens with regards to you along the road.
That is where my H seems to be right now. He is definitely reconnecting with the kids it seems, but not really yet with me though some progress, but I realize that that is really more important now anyway. They are young, they don't understand really what we are dealing with, and they are thrilled he is "daddy" again for the most part. They have missed him the past year and a half. Yes, I would love for him to be reconnecting more with me but I am an adult and do understand it all better so I think I can cope easier.
Hang in there - sounds like you are doing well overall!
