He's being passive aggressive then and you may need to get more assertive...

You can't negotiate softly with a passive aggressive.. that just leads to your exploitation and your dissappointment