Was he right to be upset or not?

Several week ago, a co-worker's friend from a party my friends and I met kept flirting with me. He was kind of drunk and kept touching my hand (I felt uncomfortable) and asking me out on a date for coffee. I thanked him for the offer but said I wasn't looking for anything serious at the moment but we can be friends.

Yesterday I went to the movies with someone I really liked and we share common interests. This was our 5th date and as we were in the line (hugging and holding hands), I heard a familiar voice saying ''I thought you weren't looking for anything serious''.

He was upset and called me another liar. He thinks I owed him the truth. Alright so I did lied but I was trying to let him down in a nicer manner. It's not that I'm not looking for anything serious but rather I'm not into you or we got nothing in common. I don't want you as a date. Was he right to be upset or not?

Updates
+1 y
The world is so small I guess. That was such an awkward moment indeed. He embarrassed me in front of my date.
Was he right to be upset or not?
Post Opinion