Guy's Behavior

What does it mean if I asked a guy out but he does not seem to find a day to meet?

I asked out a coworker for a walk and he responded with "sounds good, we can go and eat pancakes" (because he knows that I like pancakes) but we never discussed what day. So the day after I asked him what days he is free and every date he mentioned I was scheduled to work and he said he was busy this weekend. But I felt like I was being annoying when asking when he was free because he didn't seem too eager to find a day when we both could go out, so I just left the room. I mean why would he agree to go out with me in the first place?
What does it mean if I asked a guy out but he does not seem to find a day to meet?
Post Opinion