How about "I'm really sad you feel that way."