I think you need a better arrangement. You can't be at her beck and call like that. Isn't there a way for her to arrange overnight visitation? You need at least a day once in awhile to not be accountable to her.
You cannot be lonely if you like the person you're alone with. Dr. Wayne Dyer