The landowners Radzieckiai-Mikuličiai did not rush to build luxurious palaces but instead consistently developed the estate's territory according to a plan, constructing utility buildings that impress with their strength, structural durability, and decorative elements. Adjacent to the manor is a park, a local natural monument. Established in the 19th century, the park covers an area of 4 hectares. It descends impressively in five terraces towards the Gilučiai lakeshore. The park features many alleys, the most notable being the western thuja alley leading towards Marijanavas. The park boasts a variety of trees (15 species) and shrubs (17 species) uncommon to this region, including an old oak tree (trunk diameter about 1.2 m) and a nearby stone with an indentation.
The park was established during the Mikulski family's management of the manor. Although it currently has a more distinct spatial structure and is not rich in plants, it is valuable for other reasons. It is one of the few geometrically designed terraced parks in Lithuania. The main path running through the park
starts from a driveway in the northern part of the park and leads down the terrace slopes to the Gilučiai lake on the lower terrace. To this day, a beautiful alley of small-leaved linden trees remains. The park contains many old, powerful native trees – oaks, ash trees, maples, and mountain elms. Particularly impressive is the common oak growing on the upper terrace, with a trunk diameter of about 120 cm and a height of 26 meters. Among the exotic trees and shrubs, which include 19 species and forms, notable are the handsome European larches, the western thuja and its globular form (Thuja occidentalis ‘Globosa’), large-leaved lindens, gray poplars, common and Hungarian lilacs, viburnums, garden jasmines, golden rain trees, and white-flowered locusts. The most imposing is the old gray poplar, with a trunk diameter of 120 cm and a height of 28 meters. The park area also includes a barn, granary, and storeroom. In 1986, Kazitiškis Park was declared a local natural monument.
The main building of Kazitiškis Manor now houses the Kazitiškis eldership and library.