Why would a guy follow your gaze?

I have a coworker that I look somewhere and he follows my gaze. Like the other day I was looking at the door and he followed my gaze. He then was talking to me and I looked at floor because I didn't want to make eye contact with him and then he also looked at the same direction.
Why would a guy follow your gaze?
Post Opinion