Did you ever have a sit down with ex and go over boundaries, issues etc to keep things civil?
Mach you can’t be afraid to upset her. Again you can be friends with her if that works for you. If you keep politely declining she will eventually get the hint. I think you are over reacting that you turning down coffee will make it uncivil.
