On the Martensberg (mountain), some 2 kilometers northwest of Deidesheim, are found the Heidenlöcher (singular: Heidenloch – “heathen holes”), the ruins of a refuge castle, which once offered Deidesheimers shelter to which they could flee in times of war.