I would ask him, "why didn't/can't you say you love me?"