This small retreat town on the edge of the Virginia Piedmont has long served as a detox from being in the thick of things.