I would say he might be uncomfortable. Even he told you that there is nothing going on and they are just co-workers and friends, he still feels that is not completely honest. I think talking to him will not change anything, but will make him angry. I’m not sure what you can do here… I was kind of in the same situation and did everything wrong – confronting and being upset about it. I think the best thing you can do is practicing DB and be the best you can be for yourself, appreciate yourself and be confident. I like the phrase I read somewhere that goes like this: In a relationship, what you resist - persists”.
M:50 H:52 S28 (my S from previous marriage) M:17 + 3 BD: 06/12 S: 06/12 - H works in another state