I think you waited long enough. I would of backed out the 1st time you jumped him. I think the way the deer was moving it was fair game for that guy to shoot at. Well you didn't get your first buck, next one will be a 10 pt! BTW I would of knocked on his door told him the story, no harm.