many of those men who were not assigned to guard duty had walked into grabensheim , and despite the non-fraternization rules , seemed to have arranged to spend the day with some of the towns young women .