You certainly didn't do anything wrong.

Your H probably shouldn't have brought this woman into your lives.....