In our discussion, we use an HD5 file with Cross-track Infrared Sounder (CriS) data from the Suomi NPP satellite to illustrate several performance tuning techniques for HDF5 applications. The paper is organized as follows: The structure of the file and the properties of the datasets are discussed in the Study” “Case section on page 7. In the and Compression in HDF5” section on page 11, we review HDF5 chunking and “Chunking compression features in more detail. In the for Performance” section on page 15, we discuss the performance tuning “Tuning approach. The section on page 20 summarizes our recommendations. “Recommendations” In the near future, we intend to make available a new CCP (Chunking and Compression Performance) tool. This tool will allow users to vary access patterns, chunk sizes, compression method, and cache settings using the tool’s command options, reducing the need to create and compile test programs such as those used in the Study” section on page 7. “Case For more information on things that can affect performance, see the page in the FAQ on the website.
In our discussion, we use an HD5 file with Cross-track Infrared Sounder (CriS) data from the Suomi NPP satellite to illustrate several performance tuning techniques for HDF5 applications. The paper is organized as follows: The structure of the file and the properties of the datasets are discussed in the “Case Study” section on page 7. In the “Chunking and Compression in HDF5” section on page 11, we review HDF5 chunking and compression features in more detail. In the “Tuning for Performance” section on page 15, we discuss the performance tuning approach. The “Recommendations” section on page 20 summarizes our recommendations. In the near future, we intend to make available a new CCP (Chunking and Compression Performance) tool. This tool will allow users to vary access patterns, chunk sizes, compression method, and cache settings using the tool’s command options, reducing the need to create and compile test programs such as those used in the “Case Study” section on page 7. For more information on things that can affect performance, see the page in the FAQ on the website.
TechNote-HDF5-ImprovingCompressionPerformance.docx