The way I see it, he is doing what he thinks is right for him (and only him). So you need to do what is best for you. If absence makes the heart grow fonder, then he will come around. If he is an out of sight, out of mind person, then he will move on. But you can't leave your emotions hanging out for him to step on. You have to take care of yourself.