Where I hunt, none of the locals wear any orange. They smirk at me when they see me in my orange camo. Like I'm not a real hunter or something, or less of a hunter then them.
I got friendly with one of my neighbors where I hunt, although I have been going up there since I was born, hes lived there all his life. He asked me why all the 8-10 guys who hunt out of my camp wear orange during the regular season. My reply was "So we don't get shot." He looked puzzled.
Also, where I hunt, many of my spots are in or around THICK brush. I'm talking brush so thick you can't see 5 yards in some spots. Deer love this cover and it is a good place to hunt. I have many a times heard something coming through the brush only seeing brown coming though the brush, raising my rifle at the brown mass moving towards me, only to make it out as some bird brain walking through in full camo. Just a little bit of orange would (and has, many times) prevent me from raising my rifle and aiming it at you. And before anyone says anything about checking with binoculars first or making sure its a deer before taking aim, I DO where I can. In this thick stuff I hunt in, that's not possible. The deer would be gone, by the time you make sure its a deer it could be 10 yards away, you think its going to let me pick my rifle up and not see me at that distance?