You have lots of time. A lot of people don't have their first date or girl friend until older than that.
Besides, you couldn't give up even if you wanted to. At most you could make it lower priority, which might actually be a good idea if it's bothering you that much. You shouldn't let it get to you.
Not having experienced it, you might feel like you are outside looking in. You might imagine this wonderful thing that others are doing, and you are left out. But when you are outside looking in, what's inside might not be as wonderful as you imagine. It's certainly not necessary to live a happy life.
So instead of giving up, maybe just tone it down a little and not make it such a high priority in your life.
You're 20. Stop stressing, you're still young. You'll find someone and you won't go your whole life alone. Your 20's is the BEST time to be single and go out and mingle and have fun! THAT'S when you meet people who you can connect with way better than the people you grew up with and went to school with. Give it time, it'll happen.
20 is seriously not old at all, you can't even legally buy alcohol. 20 year olds seem like kids to me and I'm only 25... tons of stuff happens between the ages of 20 and 25 which completely change your situation and life. And I'm sure that even more will happen beyond that.
Try fixing or working on yourself. Like I got braces put on and now my smile looks 500% better. I'm going to have acne scar lazer treatment in two weeks. Work on personality, read books that intrest you