By 2004, the annual inflow of foreign-born persons was down 24% from its all-time high in 2000, according to the Pew Hispanic Center analysis of multiple datasets collected by the Census Bureau and other government agencies.