My opinion is that it's up to every individual. Men shouldn't be labeled gay just because they were some. Men in ancient Egypt and Rome wore it as well as men in Elizabethan England and 18th century France. Today's society is simply not used to it. That's it.
So it seems like it is not an issue for most but women but most guys said it's definitely a no go. It makes me wonder. Are guys confident enough in their masculinity? For a long time women weren't allowed to wear trousers and I feel perfectly feminine in them because my femininity is not determined by a piece of clothing.