Clothing brands mean less than SQUAT to me. I don't care if your clothes from from Barney's or Sak's 5th Avenue, or from Walmart or Ross. If they look good on you, the brand or the store or the logo is completely irrelevant.
I care more (a LOT more) about the air pressure in your car's tires, or what web browser you use, than about the name on the tag of your sweatshirt. And (HINT) I don't care very much about those things either.
No, until you told me I jad no idea that Pink was a Victorias Secret brand. I don't think that it makes much of a difference now that I know. Very few brands even register with me, and I am probably more brand aware then most men.