Are you sure we are talking about the same thing? White Pond is down by Big Buck, Lafayetteville is way up there from Taconic PKWY to Rt 199, anyway, this is what I normally do, enter from Wilbur Flats Rd, half way through there is a parking on the right, then I cut through the woods to catch the opening behind the hill...check this location: 41.979672,-73.734784...that road may be closed during winter and heavy snow so another alternative is Shore Drive in the back but that has some residents there so not sure...