Can people look at you for negative reasons? Is she right?

Whenever I wear a particular sweater with a long, grey bulky cardigan and yoga pants, men look at me. Lots of men. My mum said it looks dowdy, but she never liked cardigans. She’s suggested I get a nicer jacket. A puffer, or a leather jacket for winter. I noticed when I was catching up with my friend for breakfast, a woman glance at me, then look away and giggle. Should I invest in a nicer jacket?

Updates
23 d
I am seeking an honest opinion.
Can people look at you for negative reasons? Is she right?
Post Opinion