ZFP-X is an extended version of ZFP. ZFP-X has improved the embedded coding in the fixed-precision and fixed-accuracy mode of ZFP, which lead to the compression and decompression throughput achieved significant improvement.
Today’s scientific simulations are confronting grave limited I/O bandwidth, network bandwidth, and storage capacity because of immense volumes of data generated in high-performance computing systems. Data compression has emerged as one of the most effective approaches to resolve the issue of the exponential increase of scientific data. Among them, embedded coding is widely applied, which contributes to the dominant running time for the corresponding compressors.
ZFP is one of the most successful compressors for scientific applications in high-performance computing systems and this work continues to be optimized. We propose a new embedded coding and apply it to ZFP, called ZFP-X.
- Peter Lindstrom. Fixed-Rate Compressed Floating-Point Arrays. IEEE Transactions on Visualization and Computer Graphics, 20(12):2674-2683, December 2014. doi:10.1109/TVCG.2014.2346458.
- Bing Lu, Yida Li1, Junqi Wang, Huizhang Luo, Kenli Li. ZFP-X: Efficient Embedded Coding for Accelerating Lossy Floating Point Compression. 2023 IEEE International Parallel and Distributed Processing Symposium (IPDPS), St. Petersburg, FL, USA, 2023, pp. 1041-1050, doi: 10.1109/IPDPS54959.2023.00107.
Reference to https://github.com/LLNL/zfp