Bad move dude. You should have took the kids at let her fend for herself.

You are a doormat to her. Until that changes you will never have a relationship with her.