Utilizing In Memory Storage for MPI IO
In contrast to disk or flash based storage solutions, throughput and latency of in memory storage promises to be close to the best performance. Kove(r)'s XPD(r) offers pooled memory for cluster systems. However, the system does not expose access methods to treat the memory like a traditional parallel file system that offers POSIX or MPI IO semantics. Contributions of this poster are: 1) Implementation of a MPIIO driver for the XPD. 2) Thorough performance evaluation of the XPD using IOR with MPI IO mode. This MPI independent file driver enables high level libraries (HDF5, NetCDF) to utilize the XPD's pooled memory. We demonstrate that the MPI IO driver is able to efficiently take benefit of the pooled memory by providing it as in memory storage.