Been there done that, it sucks but it sounds like you did more work looking for that deer than 90% of hunters. Don't let it beat you up and get back in the stand.
Well I over dressed, 39 degrees at my house, get to dads house and it's 50! Only a 10 minute drive. I'm just sitting the morning on a trail they like to use in the am.