Detaching is none of those negative feelings. You don't have to ignore him or be rude in order to detach. You just don't give him that rank of importance. You are a busy lady and your time is valuable. If he wants to capture your attention/interest, then he has to make changes/adjustments, right?
It is not about what you feel should work in your M. It is about doing the work that gets the right results. Do what works!