Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extraction should fallback on NCDatasets.jl types #119

Open
Balinus opened this issue Jan 11, 2020 · 0 comments
Open

Extraction should fallback on NCDatasets.jl types #119

Balinus opened this issue Jan 11, 2020 · 0 comments

Comments

@Balinus
Copy link
Member

Balinus commented Jan 11, 2020

Context
When ClimateTools was designed (3 years ago already!) there was not a lot of options for Geographic types and quite less for climate data. From this perspective, the ClimGrid type was born. However, there is a lack of performance for the extraction of the data from netCDF files but also no support for on-disk datasets (data too large for the available RAM).

Challenge
The challenge will be to align the ClimGrid type with the CFVariable available in NCDatasets.jl. So, either we simply scratch the ClimGrid type found in ClimateBase and replace it with CFVariable (or NCDataset?). There is now some work done in NCDatasets.jl for multiple files dataset and datasets that are too large to fit in RAM and we perhaps should now look into it for a 1.0 release of ClimateTools.

Why
Now that the extraction ecosystem is mature, ClimateTools should now concentrate on climate analysis algorithms (bias correction, etc) and not on the extraction of datasets.

Idea
The API between ClimateTools and NCDatasets.jl should reside in ClimateBase. I'm also posting over there.

Any help, idea would be appreciated!

Seel also: JuliaClimate/ClimateBase.jl#2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant