Most young men do not wear watches. In fact, with everyone having cell phones, I feel as if watches are phasing out. That being said, they do look nice. Don't worry about what everyone else thinks. If you like it, wear it.
It depends on the rest of your outfit and style. For example if you wear it with a t-shirt and blue jeans then you would look like a guy who stole the watch from his daddy. If your style is pretty elegant and sophisticated then why not?