You know, honestly, depending on the guy, he will either miss you more, or think you hate him. It's really important that you talk to him and tell him how you feel, because it sounds like you really like him, and if he cares about you too, you guys can go out, but if he's one of those mean guys and does nothing after you tell him this, then he doesn't deserve you. Maybe you are afraid of him rejecting you if you say something to him, but don't be. It takes a lot of courage, I know. If you want, I can relate your experience to one of mine.
There's a girl that I really like, and last summer when school got out, I started talking to her because she said she wanted to hangout sometime. I got the hint, but because she was so busy going places during the summer to figure out where she was going to college, I had to wait until school started again for her to come back, so we could start going out. I thought that while she was gone, she would think it was nice if I sent her small texts every once in a while to let her know I was thinking about her, and she liked it at first, but after me doing that a couple times, she stopped replying, and I didn't know why. It started tearing me apart that she just didn't talk to me anymore and I thought she hated me and wanted nothing to do with me, but I didn't know why. I didn't talk to her for two months until I saw her when school started again. She actually texted me a week before school and said she lost her phone and had to wait until she came back from visiting a ton of schools in California to get a new one, then I saw her a couple days later (school hadn't started yet) and she said she was sorry about not being able to talk to me and said, "I hope you don't think I hated you." to which I just said no its ok.
So yeah, if you plan on going out with someone, don't make him miss you, it will kill him inside. It would have been nice if the girl I'm talking about would have said something to me. She could have used one of her parents phones, or her brother's or sistter's to call me and let me know what was going on because I was used to talking with her a couple times a week and then for two months straight, she just didn't say anything. Day after day I waited for her to call or send me even just a quick text saying how ya doing, but it didnt;happen, and it really just hurt so bad. This was last year and it still affects me a little.
But I guess on the positive side, she still wanted to go out with me, she just couldn't for the whole summer. So please don't avoid talking to him, it will only hurt him, especially since you have the option to talk to him; in my case, she couldn't really talk to me.