Women naturally are attracted to something I've created, a term called "tissue value". Women subconsciously are attracted to what a "man" is supposed to look like. A man is large, has thick shoulders, calves, a wide face and big head. I too am none of those things. It's like I stopped maturing at 17. I'm 6'1", 200 lbs and muscular, but the distribution is very thin. It's very hard to gain muscle without fat. I'm a true skinny fat and I hate it more than anything in the world. I have my good days and bad days, aesthetically that is. I used to have no problem meeting women in my 20s but now at 38 and separated for 6 years I can find no one that I wish to date. I will not settle either, that is NOT happiness.
Confidence does matter, but unless it's painfully obvious you are uncomfortable it is not the reason why you're having trouble as these other posters are throwing in there. You didn't say this and so I'm not sure why they're saying that.
I've found that the only women who will look at me flirtatiously are 20-14 years old, skinny themselves, or overweight, or their fathers were skinny/thin guys too. Women who are raised around thick, big men, or the women are really athletic and fit will most likely not be attracted to guys like us. That is until we nail down our nutrition and build a nice layer of muscle to thicken and add circumference throughout the skeletal frame. I've been working on it for over 20 years. When I was young it was the steroid era of diet and workout advice that led me no where. Only now with guys like Nate Miyaki and Anthony Mychal have I been able to make better gains. I always thought when I reached 30 I'd look like a man, now I think, when I'm 40. It probably will never happen and I've learned to be ok with it. My hope is that the next 24 yr old I meet will accept me. That is the only age I meet, for 6 years now. Women my age don't take me serious and I hate it. They look so much older, mature compared to me. I'm good-looking, I don't get it.