I like it a lot. When the girl puts a lot of product in her hair, it smells nice and really gets my attention. If I'm directly behind her and she does the "whoosh" thing (for whatever reason, to tie it up mostly) I go crazy. It seems like such a huge flirt move, like she's begging me to smell her, and you know...
But yeah, you can never make these assumptions with strangers!
If you're playing with your hair every time I look at you it might get a little annoying. But if you're just tidying up your hair to look it's best once in awhile then I don't see any problem with it. It's all about moderation.
I think it's cute, and it seems that I'm not alone in this category.
When it the one girl I'm interested in and she's getting a little jealous or just trying to preen to get my attention, I find it kind of cute. When I'm sitting with 6 girls and they are all going it at the same time, its a bit much and a little funny.
i don't know about guys but I know it bugs me. but only because hands get dirty, and I love nice clean pretty hair. when you touch a lot of things you get tons of germs on your hands, or food, grease. then you touch your pretty hair and , blegh