Being LOVING to him does not mean treat him like an infant.
It means don't say anything hurtful.
And you can be loving for a while, but if it pushes him away, which it appears to be doing, then you need to distance yourself.
He has complained about all the calls, he has complained about you being at your house often, he clearly finds your presence difficult for him. Smothering him is NOT going to help you, so LOVING in this sense is subject to some interpretation.
Sorry, but being loving sometimes means hurting someone. Read the articles I posted to you. The second one in particular. The first one may not be all that relevant, but it was important that you know it.