Produce re-chunked data based on ICESat-2 data production script

[asteiker]

Tasks

Beta Give feedback

1. Generate re-chunked ATL03 test file: Page Agg + 100K chunk size
2. Investigate file size increase when using paged agg + rechunked
3. Generate re-chunked ATL03 test file: User Block + 100K chunk size
4. Generate re-chunked ATL03 test file: User Block + original chunk size
5. Generate re-chunked ATL03 test file: Multiple file sizes

[asteiker]

See https://github.com/ICESat2-SlideRule/sliderule/blob/main/clients/python/utils/i2_optimize.py to leverage for the generation of the re-chunked files.

[betolink]

I generated a new batch of cloud-optimized ATL03 files to test. I also opened a discussion on SlideRule https://github.com/orgs/SlideRuleEarth/discussions/398 to start testing them on their side. Next I'll be generating our kerchunk files again and running the benchmarks one more time.