Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data pipeline modifier for c2smsfloods benchmark dataset #75

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

lillythomas
Copy link
Contributor

Redux of the data pipeline to process the Cloud to Street - Microsoft Flood Dataset into datacubes along the lines of what our pretext model learned from.

Full raw dataset on S3 at s3://clay-benchmark/c2smsfloods/

Datacubes will be 512x512xC pixels due to the original chip size of the dataset.

Relates to https://github.com/Clay-foundation/office/issues/22.

@brunosan brunosan mentioned this pull request Dec 7, 2023
@lillythomas lillythomas force-pushed the c2smsfloods_benchmark_datapipeline branch from 0bc8183 to aca383a Compare December 8, 2023 01:15
@lillythomas lillythomas force-pushed the c2smsfloods_benchmark_datapipeline branch from ea9c3ba to 9849db2 Compare December 8, 2023 01:25
@lillythomas lillythomas force-pushed the c2smsfloods_benchmark_datapipeline branch from b0b03c3 to 76c7b8f Compare December 8, 2023 22:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant