When I see a guy in a military/police uniform, my attention is automatically drawn to him. Sometimes it's more about the uniform than the guy. With scrubs, I'm so used to seeing my sister in them that it's hard to find them particularly attractive. I notice the guy, not the scrubs.
for me, the reason a man in uniform is hot, is because he has a profession in which you have to excel at a specific skill. and in order to succeed you have to be passionate about it, I find that incredibly sexy. so in order to be a surgeon you have to be pretty friggin good at it, so yes, scrubs is sexy to me.