during the middle of the 16th century, the castle was rebuilt as a schloss (a fortified home rather than a pure defensive structure) by the "von leonrodt" family that ruled from 1535 until 1637. in 1637 the "von st. vincent" family took over the schloss. nearly a century later, in 1749, johann rupert von st. vincent sold the feudal estate and castle to the princely house of thurn und taxis. until 1851 the castle was used by the princes' chief hunter and later as a princely rental property. in 1865 the community of ballmertshofen received the schloss, which was used as a school and town hall. following the beginning of world war ii, in 1940, the castle was used as a prisoner of war camp.