On their rare days off , the players seldom strayed from Grymes Hill , a leafy neighborhood in Staten Island where they had unadorned Wagner College apartments , sleeping two to a room like students or , for that matter , migrant laborers .