-
Notifications
You must be signed in to change notification settings - Fork 15
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Gridded VIIRS from the NOAA AWS bucket #164
base: develop
Are you sure you want to change the base?
Add Gridded VIIRS from the NOAA AWS bucket #164
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you run the pre-commit hooks?
How long does it take to get a small amount of data (for test)?
just a few seconds at most |
Not quite sure how to do that. Can you provide a little instruction? |
I added back in the NRT data. Seems the AWS server didn't have a the latest data from the past 3 years. in the NRT data we don't have the 0.05 data but we do have the 0.1 and 0.25 degree data. |
|
Sweet, do you want a write a test? I can give it a go if not. |
Thanks! Added it and got these rolling. Seems the tests are failing but in unrelated spots where the code was changed |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Some comments on the gridded open_dataset
Co-authored-by: Zachary Moon <zmoon92@gmail.com>
since s3fs fails to import
04b8476
to
e8d6515
Compare
…noaa/monetio into feature/viirs_aws_gridded
right now these don't pass
since sat_name doesn't get set
as long as have at least one
since nothing to return, unlike mfdataset, where we still have something as long as there is at least one file that does exist
Added a new function to stream data from AWS from the noaa-jpss bucket into xarray for monetio. This should be useful for satellite comparisons.
It can handle both SNPP and NOAA20 satellites as well as varying resolutions (0.05, 0.1, 0.25 degree) and different time aggregations that are preprocessed by NESDIS (daily, weekly, monthly).
Data availability is from 2012 -> current.
to use:
@angehung5