The Brunstorp Garden was purchased by Bishop Markusson of Linköping in the 14th century. In the 16th century, the farm passed into state ownership, and in the early 17th century, it became privately owned. Some owners in the 18th century were associated with the gunpowder industry. In 1953, the then-town of Huskvarna acquired the farm to include it in a planned recreational area. In 1972, the Huskvarna Mountains Nature Reserve was established, in which Brunstorp is included.
Kurt Grimlund, from Huskvarna, donated his plant collection to the Huskvarna Gardening Society. Around 500 species and varieties from this plant collection have been planted at Brunstorp. Rock garden plants of high botanical value were donated by Kjell von Scheele from Huskvarna. The Adolfsson family in Tenhult has donated several different perennials, primarily Primulas, to Brunstorp. Through these donations, Brunstorp can showcase botanical material that is not found in many other places in Sweden.
There is also a herb garden in the courtyard, with a large number of herb plants.