Beards make me think of old men. Mustaches are gross to kiss.
but it really all depends on what you're going for, plus the great thing is you could grow it out and if it looks ridiculous you can shave it off no harm no foul but, for an example of the elusive "scruff" just look at david beckham he always is looking good, to me of course, and he's got the hot manly scruff a lot of the time.
It's funny...I've never liked facial hair on any of the men I've ever dated, but I can't bear the thought of letting my current guy shave his goatee and thin, sculpted beard. It's really sexy on him. I think that's the point though - every guy has to see what works for him. Just try a few different styles out. It's just hair and it can be manipulated and shaved away if you don't like it. I would definitely avoid the mutton chop though. I'm not sure anyone would ever call that "sexy."
i don't like the clean shaven look at all. I like my guys looking like they've one through puberty. lol. I don't have a specific style that is my fave though because different styles suit different men. eg Johnny Depp and Rai Thistlethwayte look incredibly sexy with a moustache but other men just look seedy when they grow them.