nothing to add here, FaithnAK covered everything and then some, nice job bro ;-)
Pickle, all we can ask is listen to the advice.
If you're afraid of rocking the boat, don't be, your wife wasn't afraid to rock the boat, hopefully you're not afraid of her.
When you feel fear in a specific situation, stop yourself and think about what it is you're truly afraid of. Is someone physicallyl threatening your life or the lives of your children? That would be a valid fear. If someone is taking advantage of your good nature and cheating on you, don't be afraid of that person, realize the need to stand up for yourself and respect yourself to stop allowing people to take advantage of you and use you.
You sound like a nice guy and there's nothing wrong with being a guy who is nice, just make sure you're not being nice so that others will accept you and approve of you - never go down that path in your life, it never works, that is what they call a "cheeseless tunnel" ;-)