Releases: pangeo-forge/pangeo-forge-recipes
0.10.7
What's Changed
- Retain original _FillValue in encoding by @maxrjones in #711
New Contributors
- @maxrjones made their first contribution in #711
Full Changelog: 0.10.6...0.10.7
0.10.6
What's Changed
- Ab/consolidate release notes by @abarciauskas-bgse in #706
- Minimal multidim rechunk fix by @cisaacstern in #708.
Full Changelog: 0.10.5...0.10.6
0.10.5
What's Changed
- Add pytest-xdist to speed up tests by @jbusecke in #651
- Checkout tags for local install by @jbusecke in #650
- Bump to myst-nb==1.0.0 by @cisaacstern in #641
- Kerchunk WriteCombinedReference return fsstore by @norlandrhagen in #660
- Consolidate Metadata Transform by @norlandrhagen in #665
- Reuse
FSSpecTarget
Auth Credentials by @ranchodeluxe in #668 - Pass zarr encoding through StoreToZarr() by @thodson-usgs in #674
- Pinning pytest to fix ci test failures by @norlandrhagen in #681
- ConsolidateMetadata2 by @norlandrhagen in #678
- ConsolidatedDimensionCoords Transform -- cleaned up version of PR #556 by @norlandrhagen in #671
- Update index.md by @abarciauskas-bgse in #664
- Make mypy happy (
type
is not a class instance) by @moradology in #693 - Add logging to StoreToZarr by @jbusecke in #657
- Use MapTuple, put higher-order index type in
types
file by @moradology in #694 - Tests to illustrate
CombineReferences.bucket_by_position
by @ranchodeluxe in #697 - Fix CombineReference merge ordering by @moradology in #689
- Assert Uniform by @ranchodeluxe in #698
- Remove add_keys_iter by @moradology in #700
- Fix WriteCombinedReference FSSpec Credentials Yet Again by @ranchodeluxe in #703
New Contributors
- @thodson-usgs made their first contribution in #674
Full Changelog: 0.10.4...0.10.5
0.10.4
What's Changed
- Fix broken contributing link by @cisaacstern in #640
- Bump sphinxext-opengraph from 0.8.2 to 0.9.0 by @dependabot in #642
- Add
minio
to Integration Tests by @norlandrhagen in #638 - Disable
fsspec
Cache on Integration Tests by @ranchodeluxe in #646 - Dynamic chunking interface for StoreToZarr by @cisaacstern in #595
New Contributors
- @ranchodeluxe made their first contribution in #646
Full Changelog: 0.10.3...0.10.4
0.10.3
0.10.2
0.10.1
- Add sentinel as default for transform keyword arguments that are required at runtime and which recipe developers may not want to set in recipe modules. This allows recipe modules to be importable (i.e., unit-testable) and type-checkable during development. #588
StoreToZarr
now emits azarr.storage.FSStore
which can be consumed by downstream transforms. This is useful for opening and testing the completed zarr store, adding it to a catalog, etc. #574- Concurrency limiting transform added. This base transform can be used to limit concurrency for calls to external services. It is now used internally to allow
OpenURLWithFSSpec
to be limited
to a specified maximum concurrency. #557 - Various packaging, testing, and maintenance upgrades https://github.com/pangeo-forge/pangeo-forge-recipes/pull/565` https://github.com/pangeo-forge/pangeo-forge-recipes/pull/567` #576
- Patched deserialization bug that affected rechunking on GCP Dataflow #548
0.10.0
Major breaking change: This release represents a nearly complete rewrite of the package, removing the custom recipe constructor classes and executors, and replacing them with a set of modular, domain-specific Apache Beam PTransforms, which can be flexibly composed and executed on any Apache Beam runner. The documentation has been updated to reflect this change. As the first release following this major rewrite, we expect bugs and documentation gaps to exist, and we look forward to community support in finding and triaging those issues. A blog post and further documentation of the motivations for and opportunities created by this major change is forthcoming.
0.9.4
0.9.3
- Bugfix to allow opening of zarr files. This fix allows using Zarr stores as an input source for recipes. #462
- Add netcdf3 support for opening source files with kerchunk. Resolves a long-standing issue wherein netcdf3 source files could not be loaded lazily, which effectively blocked the use of large netcdf3 files as recipe sources. #383
- Fix zarr reference bug #455
- Add
dataset_type
class attribute for recipe classes #437