Adkbuck mentions wind direction, which might be the biggest factor, but I believe age, maturity, and gender have a lot to do with it also. A yearling doe might want to be your pet, but a 5 year old buck knows (regardless of wind direction) that you are danger.