Also, have you ever told his parents that this D is not something you want?

I could be wrong, but you seemed so passive when the D was asked for--maybe you felt ambivolent at the time--but perhaps they took it as you not really caring about their son that you went along with it all so easily.

If my H is ever serious about a D, my in-laws will be told that my stance is that I DO NOT want this! Well, unless I have been DBing forever and I do.