i think it depends on the picture and the angle. but i mean, beyonce also looks better than most normal girls and celebrities with makeup so for the most part, yes, of course she looks better without too. :p
She is by no means ugly, but I wouldn't say she is beautiful or above average in looks. I know a lot of women who look 10 times more beautiful without makeup than her and a lot of other celebrities. A lot of times we still project the celebrity image on her even though her looks average without makeup. Same for other celebrities.