In the mid fifties, John Oliver Jr. took an interest. Karl Simson retired, and the nursery was reincorporated as Oliver Nurseries, Inc. The specialization grew to include rare and dwarf evergreens, and soon the word began to spread. Alyce Sutcliff, of the Brooklyn Botanical Garden, called Oliver's the "Tiffany of the nursery business." In the early sixties, a local rhododendron grower, Bill Efinger, joined forces and the nursery moved to its present location. Illness took Bill in 1967 but his expertise in growing remained. It was also at this time that John Sr. retired to Florida and John Oliver Jr. became president.
