Ok...what SPECIFICALLY did he ever tell you he needed to feel that there was passion? To feel that you weren't just living as roommates? You cannot fix something like this if he cannot give you specifics.
What type of a physical relationship did you have...did he initiate/you reject? Vice-versa? It's hard to help without specifics.
One thing I definitely want to ask though with the problems you two have had with infidelity in the past is this...have you two been to marriage counseling? If not...why not?