Jonathan Tran, 26, was in the grounds for more than 16 minutes before he was detained, it said.
He now faces a maximum sentence of 10 years in prison.
In a statement, the Secret Service said it was "extremely disappointed and angry" about the events of 10 March.
Mr Tran did not gain entry to the White House, where President Donald Trump was staying at the time.
However, Congressman Jason Chaffetz - whose House Oversight Committee oversees the Secret Service - claimed the intruder had managed to rattle a door-handle at the South Portico entrance.
According to court documents, Mr Tran told federal agents that he was a friend of the president and had an appointment.
He was carrying two cans of mace, a US passport, a computer and one of Mr Trump's books, authorities said.
The president praised the Secret Service for doing a "fantastic job" in apprehending the intruder.
Mr Tran had managed to climb a 5ft (1.5m) fence near the US Treasury Department, which is next to the White House. He then scaled an 8ft vehicle gate, and a shorter fence near the east wing of the White House grounds.
CNN reports that he set off several alarms after jumping the fence, but was able to avoid other sensors.
Mr Tran, who comes from Milpitas, California, had reportedly been spotted "looming around" Washington's Pennsylvania Avenue, where the White House stands, nearly six hours before his arrest.
The Secret Service said it had taken immediate steps to avoid further security lapses, and that over 50 people had been interviewed about the incident.
The intrusion was the latest in a series of breaches at the White House in recent years.
Security has been enhanced. In 2015, sharp spikes were installed on top of the black iron fence that circles the property.

The number of turbines on the Kentish Flats wind farm is being increased from 30 to 45, with the operation being co-ordinated from Ramsgate.
Swedish energy company Vattenfall said six turbines had so far been installed on its site, off Herne Bay.
All 15 will be switched on later this year, and it is expected they will be fully operational and exporting power to the national grid by early 2016.
Matthew Green, project director, said the original 30 turbines could produce enough power for 40,000 homes.
The additional 15, which are slightly larger, will be enough for another 35,000 homes.
"They have larger rotors so we're able to make use of lower wind speeds to get more power," Mr Green said.
Vattenfall also owns and operates the Thanet offshore wind farm.

Shiyi Ying, 25, was given permission to take to the stage towards the end of the ceremony at Southampton University to pop the question to Yu-Yen Ou, 24.
He said: "Deep inside I know you are the only one I can share the rest of my life with," before she accepted.
Vice-Chancellor Professor Don Nutbeam said it was "certainly a first" in his 25 years attending graduations.
Both students were receiving their masters degrees. Mr Ying, from Beijing, had studied for an MSc International Management and Ms Ou, from Taipei, had studied MSc International Financial Markets.
After Ms Ou said yes the couple hugged - prompting applause from fellow graduands, guests and staff gathered inside the theatre.
Prof Nutbeam said: "I'd like to offer the couple huge congratulations and every best wish for the future."
The US Secret Service has released new details of last week's White House fence-jumping incident, in which an intruder was discovered just steps from the main building.
[NEXT_CONCEPT]
Work to expand one of Kent's three offshore wind farms has got under way.
[NEXT_CONCEPT]
A university student has proposed to his girlfriend during a graduation ceremony.