Oh, on a semi-related note, this reminds me of a Robert Redford movie link
People need people. Without other people, you would have to do everything yourself. You would have to grow your own food, cook your own food, clean up, fix things around the house, build your own house, defend your own house, well, actually you wouldn't exist, because if everyone would be by themselves, the whole human population would die off in just one generation.
People need to mate, to create children. And besides mating, people need to socialize, to exchange "benefits of trade". For example, if there's an accountant in your family, and you are a dentist; you both work out a system where you don't "charge each other money". You would rather have "favor IOUs" than "financial IOUs". Why? Simply because the favor IOUs are more valuable. If he helps you with your taxes, that'll only save you $300. And if you "pay him", you're no longer indebted. But if you owe him a favor, and he needs a root canal, he's saved "$1,200". The reason you both do this is because the "favors" you're both exchanging have very little to minimal cost to both of you. So you both get hundreds of dollars in value, for only less than $50 in cost.
When two people meet, they assess the value that the other has to offer them very quickly. If you saw Donal Trump, or Oprah; you would WANT to associate with them. They have value you want. But they don't want to associate with you. So what do you continue to do? Do you continue to try and be their friend, and be nice to them, and clean their home, and do favors for them, and ask them out to dinner, or to a party? Or do you just go on with your life?
Here is how people meet:
1. Awareness: people become aware of each other
2. Assessment: people assess the other person's value
3. Interest: people are happy with the initial assessment & curious about the WHOLE package
4. Initiation: people initiate contact or an interaction
5. Acceptance/Rejection: if both people feel that there is mutual benefit/gain to be realized, they accept the initiation & reciprocate. if both people don't feel that there is a mutual benefit/gain to be realized, they reject the initiation & do not reciprocate.
6. Aftermath: Following an acceptance, the two people look to establish attraction, connection and closeness so that they can continue to enjoy the benefits/gain of the other person for a long-period of time. Following rejection, two people go their own separate ways & do not waste any more time or resources on a non-mutually wanted relationship.
(you can imagine how tragic mixed messages from shyness "low-self-esteem" and playing hard-to-get "insecurity" are for two people who WOULD have a mutually beneficial/gainful relationship together)
When he looked at you and you looked away, it seems like he felt that was a rejection on your part, and that you weren't interested in you (and TELLING HIM) in a tactful way.