Oh stop it. ENJOY the attention but divert your eyes and just tell yourself not to "go there." You know how to live by a code, you know how to skate by an opportunity just slow enough to drink in some validation that you are wanted... There is nothing wrong with being noticed and feeling good about it. Just don't dance too close to the line. Never EVER act on it, because it will ruin your life and you will destroy your family. We both know you don't want that.
He is turning it into a fight. Don't let him. Stay firm on your stance without being "demanding." I'm sure that you are surprised by his reaction, and he should know that his reaction is not what you expected. I would call him on his shield of anger and tell him that it is not a productive way to handle someone you love.
Don't be sad or hurt or afraid that he is mad. Tell him that you don't want to drive him away, but that you desperately need to talk about this with him.
You know... Too much talk before you read more isn't the best way to go. Try to smooth things out as much as possible without recoiling from your stance and then start reading your butt off. You'll get all kinds of wisdom that will help you feel sure about how you handle these discussions.
If you want, you can drop his lunch off at his work with a quick, "You forgot this" and a smile and a wave and a quick departure. Take the power away from these antics. ("I'm so mad at you, I'll show you... I'll REJECT your lunch and withhold any ounce of appreciation." Silly, no?)