Why didn't he wave back?

There's a guy who works in a car shop on the corner which I walk past every day to get a coffee, it's a good 30 feet away from the sidewalk so I can't simply say hi. It's been going on for about 4 months now. Every day he stares at me and makes a point of standing at the entrance of his work watching me as I walk by. When his coworker is standing with him, he seems to have more confidence, he smiles and once he even waved at me (I froze of course and my arm wouldn't cooperate when I told it to wave back at him) The other day his coworker wasn't with him, when I looked over he jolted and looked away so I figured he must be shy like me. So today I got the courage and as he smiled at me, I smiled back and waved at him. He didn't return the wave but his posture/body language changed then he turned and said something to his coworker, thus making me feel like the biggest tool in the world. So my question is, what's going on? I gave him an opening why didn't he take it and wave back? Did I shock him or am I reading too deep into everything?
Why didn't he wave back?
Post Opinion