Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for MERRA2 data #308

Closed
jacobbieker opened this issue Apr 30, 2024 · 1 comment · Fixed by #310
Closed

Add support for MERRA2 data #308

jacobbieker opened this issue Apr 30, 2024 · 1 comment · Fixed by #310
Assignees
Labels

Comments

@jacobbieker
Copy link
Member

jacobbieker commented Apr 30, 2024

To use MERRA2, we need to make some updates to datapipes. Primarily:

  1. Add a function in load_nwp that can load the MERRA2 Zarr and transform it into the standard NWP format that datapipes uses, which means, 5 coordinate variables
    init_time_utc, step, latitude, longitude, channel
  2. Add test data and a test to show that opening the data gives the correct shape

Example shape from loading ECMWF:

<xarray.DataArray 'ECMWF_BLAH' (init_time_utc: 1, step: 2, channel: 2,
                                latitude: 221, longitude: 221)> Size: 781kB
dask.array<transpose, shape=(1, 2, 2, 221, 221), dtype=float32, chunksize=(1, 2, 2, 221, 221), chunktype=numpy.ndarray>
Coordinates:
  * init_time_utc  (init_time_utc) datetime64[ns] 8B 2023-09-25T12:00:00
  * latitude       (latitude) float64 2kB 31.0 30.95 30.9 ... 20.1 20.05 20.0
  * longitude      (longitude) float64 2kB 68.0 68.05 68.1 ... 78.9 78.95 79.0
  * step           (step) timedelta64[ns] 16B 00:00:00 01:00:00
  * channel        (channel) <U5 40B 'dlwrf' 'dswrf'
Attributes:
    Conventions:             CF-1.7
    GRIB_centre:             ecmf
    GRIB_centreDescription:  European Centre for Medium-Range Weather Forecasts
    GRIB_subCentre:          0
    institution:             European Centre for Medium-Range Weather Forecasts
@AUdaltsova
Copy link
Contributor

Fixed with #310

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants