AD, good luck on your decision. It does sound like you know what you want and how you want to behave. Stick to your guns, don't let him pressure you to do something you are not comfortable with.
You can not change your past, but you can ruin a perfectly good present by worrying about the future.
