I guess it's true to some degree, but I like the way I dress. Cardigans, khakis, sweaters, blazers, leather shoes and dress pants - that's me.
Although I like the way I dress I don't want it to affect my (already slim) chances of finding a decent girl. The girl who said it, said it in a derogatory sense, and it has made me second guess what I wear ever since. Is this something that would matter to you? Honestly.
To me that sounds more like class. It means u dress more mature than most 18 year old guys who have never heard of a belt and wear their pants so low everyone can see their underwear. It's just not presentable. I love it when guys wear blazers and dress pants, shirts tucked in... It says to me he's not lazy and knows how to take care of himself well. Sadly where I come from its a rare sight. I wouldn't take it as a bad thing. Infact, I wish more men dress like u haha :p