I sometimes go back to walk through the ghostly remains of Sutton Place where the rude, new buildings stand squarely in one another's river views