I doubt he was turned off, but you do need to take time to heal. I understand your concern, b/c I had heard all the horror stories too, but it shouldn't make any difference with your feelings. However, my doctor told me to wait 6 weeks to have sex and when we did, I could tell I had had surgery, so be very careful.
It is not about what you feel should work in your M. It is about doing the work that gets the right results. Do what works!