Modern charts no longer show the name Shelter Key, but use instead Key Colony Beach. When Phil Sadowski developed Key Colony Beach in the 1950's, much filling and landforming was done. It was at this time that Shelter Key seems to have lost its name.