Shy guys, am I wasting my time? Should I back off?

I've been trying. Initiating, flirting, talking, smiling. I think we have gone in some direction. I mean, he does give me his full attention and he will touch me and look at me, even say hi on his own sometimes. I just feel a little down. He expects me to do everything, including coming over there to see him (driving to his town not too far away). He even said 'Next time you come...' And I don't know if I should back off and not come as often? He's not doing much to help and he hasn't actually accepted an invite to hang out yet. He doesn't say no exactly which is completely frustrating but he won't accept and I have asked twice now. So maybe backing off and him seeing my world doesn't revolve around him will help? He's mid twenties, out of college and working if that makes any difference. I work too, which is why I am feeling a little down. It seems my time is being wasted. We've been 'friends' for 6 months now.
Shy guys, am I wasting my time? Should I back off?
Add Opinion