Hi sweetie. Good for you for wanting to start out on the right foot with your new bf.
Ok, so, now you have important information. If it were me, I would ask him why he feels that way.
Is he uncomfortable approaching you about things, or doesnt feel you are really hearing him or maybe he feels that you are not 100% there for him?
Let's face it, there are things in your life that are drastically different than in his. You have kids and you were married. And you have a million things on your mind and on your plate. Those things come into play in a relationship with someone who doesnt have those things.
But, once you find out what he means, you can then actively work on what you feel you should work on.
You might try mirroring what he said so he is sure you understood it.
You are still so early into this. You are just beginning to learn the nuances about each other.
You are right to take it slow and see where it goes.
Make the changes if you feel YOU feel you need to.
