Don't feel awkward! Either way is perfectly OK. What is not OK and he will feel that is that you feel awkward. That turns him down usually (but sometimes up, because he know that you like him). Just don't feel awkward. It is OK.
It way very well be a good thing, if you care about him that much that you worry about what he'll think, but it would be good to get over, if it lasts you'll need to know that you can look him in the eyes.