Edisto Island, 1861 to 2006 door Earl Charles Spencer