The house now known as Glynde Gardens was built for the head gardener at Glynde Place in 1757, together with the walled kitchen garden at the rear of the house to the north-west, which grew the vegetables and fruit for the household at Glynde Place. This was part of major building and re-modelling at Glynde Place undertaken by Richard Trevor, Bishop of Durham, who hade become owner of the Glynde Estate in 1743. A Glynde Estate account book shows that Thomas Standley, bricklayer, was paid £15.15s.7d for the residue of work "for the gardener’s house", 20 June 1757 and William Weller, carpenter, was paid £26 13s 6d for his bill for the gardener’s house on 31 December the same year. The account book also shows that under improvements made to Glynde Place in 1757 a total of £71 6s 5d was spent on the new gardener’s house with amounts of £14 16s 9d and £12 11 8d spent in 1758. In 1757 sums of £65 13s 5d and £49 19s 8d were expended on the new kitchen garden and pond, with a further £4.12.00 and £28 15s 9d spent in 1758.

The first occupant of the house was William Cornwell, Richard Trevor’s head gardener, who appears to have been in charge of affairs at Glynde Place when Richard Trevor and his household were away at the bishop’s palace at Bishop Auckland or his house in London. In 1841 Barnard Skinner, head gardener at Glynde Place, was living here. The Sussex Express of Saturday 3 Jan 1846 reported on a coroner’s inquest held on the body of ‘Bernard’ Skinner at the house of the deceased. Skinner had been a gardener at Glynde Place for forty years but his son, landlord of The Cock at Ringmer, had died three weeks earlier and Barnard Skinner had asked his employer General Trevor whether he should take over the pub. General Trevor had advised him to do so but Skinner apparently regretted his decision which disturbed his sanity. He cut his throat with a razor on 17 Dec 1845 but survived. However, his mental health deteriorated and he tore open the wound and died. George Lusted, who had been under-gardener at Glynde Place for fifteen or sixteen years, gave evidence at the inquest and described Barnard Skinner as his uncle.

The gardens continued as the cottage gardens for Glynde Place until the first World War. In 1950 Joan and John Vincent were living there but from 1955 to at least 1970 John and Beatrice Wheare were running a market garden business from the site which also had a shop, called Glynde Gardens, at 19 High Street, Lewes. The house is now let out by the estate separately from the gardens.