Tom Pickard, agent of the Glynde Estate, had purchased Harveys, then called Grapevine, and Step Cottages from Harvey Smith because he was worried that the property would be bought by someone who "might become a nuisance in the neighbourhood to everyone and as an old parishioner I want to keep it out of the hands of such." Pickard bought both properties in 1920 or 1921 with a view to moving to Harveys on his retirement. On Pickard’s retirement he evicted the Turner family, who had been tenants since the late 19th century, and converted the house back to a single residence, changing the name from Grapevine to its present name of Harveys, in recognition of the family that he had purchased the house from.

Tom Pickard and his wife had two children - Cuthbert, who died in November 1918 and is recorded on the village war memorial, and Kathleen. Kathleen was interested in music and also flora and fauna. She became the principal and owner of the Brighton School of Music and kept a menagerie of reptiles in the house and garden at Harveys. Kathleen married Frank Smith, a Canadian serviceman who had been stationed in Glynde during World War II and adopted the surname Pickard-Smith.

When her father became ill in his old age Kathleen sold the Music School to give herself more time to look after her father. This also gave her the opportunity to give more attention to her garden and her reptiles, publishing a book Living with Reptiles. Tom Pickard died in 1955 and Kathleen continued to live at the house until her death in the late 1990s.