It make sense to be your H's friend when he is in withdrawal, especially because there is no OW competing to satisfy his emotional needs...he will associate the peasant feelings with you.
It does make sense. It can also be pretty difficult at times. Be patient with yourself.