The caverns comprise an irregular series of neo-Romanesque ambulatories and chambers hollowed out of red sandstone, with carved archways, pillars, symbols and niches, apparently for candles. They are located about 250 metres west of Caynton Hall, beneath privately-owned woodland, within a disused stone quarry. One suggestion is that they were the result of quarrying during the mid-19th century and were then turned by the landowners, the Legge family, into a grotto or underground folly.
