He ignores me in conversation but talks to everyone else?

This guy at my work started a conversation with our staff table at lunch. I was sitting directly in front of him. He's telling the story and a few people are adding comments here and there and he i s looking at pretty much everyone at our table. BUT during the entire lunch we only made eyecontact like twice. Once we both just looked at eachother and kind of smiled and nodded lol. It was kind of awkward. Then the other time I added a comment and he looked at me but didn't really say anything else. After lunch was over we were leaving and he was flirting physically, like just being silly to me. He usally doesn't make eye contact with me during lunches but will with other people, even if I try to be apart of the conversation. So what's his deal? Why would you do this?
He ignores me in conversation but talks to everyone else?
Post Opinion