Obtain worldwide current weather data efficiently?
I can download the world's current weather data by visiting:
 
ftp://tgftp.nws.noaa.gov/data/observations/metar/decoded/
 
and downloading all the files there, perhaps ignoring the ones over 2
hours old (or whatever).
 
Is there a more efficient way to do this? Downloading 4K+ small files, 
even with curl and GNU parallel, is slow, even though the total size of the 
download is fairly small 

Obtain worldwide current weather data efficiently?
===

I can download the world's current weather data by visiting:
 
ftp://tgftp.nws.noaa.gov/data/observations/metar/decoded/
 
and downloading all the files there, perhaps ignoring the ones over 2
hours old (or whatever).
 
Is there a more efficient way to do this? Downloading 4K+ small files, 
even with curl and GNU parallel, is slow, even though the total size of the 
download is fairly small 
