Take the trip. Give her only a "I'm sorry you feel I'm being selfish, but I really can't control how you feel, and I'm very comfortable with how generous I've been with both my time and my extra income. I didn't expect you to agree or even understand; I was really just letting you know as a respectful courtesy."
Choc., who wishes he had done ANY of that sort of thing in HIS marriage