Depends on the guy. Some look better with it than others. In general though, I'm attracted to guys with darker features (some Asian and Latin/Hispanic races), so it's a little more attractive if they have more hair because it enhances the darker features I'm attracted to.
I have a strong preference for facial hair. Honestly, my boyfriend talked about shaving his completely off and I got a bit disappointed. I would still be attracted to him and everything without it, but definitely find it very sexy. When he first grew his goatee it had been a while since I had seen him. He sent me a pic of it and I was super turned on immediately.