Secret Service agents guard the residence 's entrances on the first floor and ground floors , but the first family has privacy in the quarters themselves .
The first family has privacy in the quarters despite the Secret Service agents guarding their residence .