Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Onboard GEOS-FP dataset #130

Merged
merged 17 commits into from Aug 18, 2021
Merged

feat: Onboard GEOS-FP dataset #130

merged 17 commits into from Aug 18, 2021

Commits on Jun 17, 2021

  1. config files for rolling 10-day pipeline

    @adlersantos
    adlersantos committed Jun 17, 2021
    Configuration menu
    Copy the full SHA
    ce9de3a View commit details
    Browse the repository at this point in the history

  2. generated Terraform files

    @adlersantos
    adlersantos committed Jun 17, 2021
    Configuration menu
    Copy the full SHA
    c2ff83e View commit details
    Browse the repository at this point in the history

  3. generated DAG file

    @adlersantos
    adlersantos committed Jun 17, 2021
    Configuration menu
    Copy the full SHA
    0f4ee29 View commit details
    Browse the repository at this point in the history

  4. container image for GEOS-FP

    @adlersantos
    adlersantos committed Jun 17, 2021
    Configuration menu
    Copy the full SHA
    451dfdf View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2021

  1. increased memory and cpu for container

    @adlersantos
    adlersantos committed Jun 18, 2021
    Configuration menu
    Copy the full SHA
    e98f9fc View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2021

  1. Merge branch 'main' into geos-fp-dataset

    @adlersantos
    adlersantos committed Jul 22, 2021
    Configuration menu
    Copy the full SHA
    5f4a8f7 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2021

  1. install wget in container

    @adlersantos
    adlersantos committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    6fc2c90 View commit details
    Browse the repository at this point in the history

  2. revised container script to use one manifest file per date

    @adlersantos
    adlersantos committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    95c303c View commit details
    Browse the repository at this point in the history

  3. revised DAG to use one operator per date

    @adlersantos
    adlersantos committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    ef241d7 View commit details
    Browse the repository at this point in the history

  4. regenerate DAG .py file

    @adlersantos
    adlersantos committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    dc98136 View commit details
    Browse the repository at this point in the history

  5. fixed YAML linting

    @adlersantos
    adlersantos committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    8e25ee7 View commit details
    Browse the repository at this point in the history

  6. set schedule to be slightly after midnight UTC

    @adlersantos
    adlersantos committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    8bcecaf View commit details
    Browse the repository at this point in the history

  7. add retries

    @adlersantos
    adlersantos committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    a0c523e View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2021

  1. add kpod timeout and simplified old data prefix

    @adlersantos
    adlersantos committed Jul 30, 2021
    Configuration menu
    Copy the full SHA
    fd356d5 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2021

  1. removed trailing whitespaces

    @adlersantos
    adlersantos committed Aug 4, 2021
    Configuration menu
    Copy the full SHA
    87cc932 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2021

  1. Merge branch 'main' into geos-fp-dataset

    @adlersantos
    adlersantos committed Aug 13, 2021
    Configuration menu
    Copy the full SHA
    f2000e8 View commit details
    Browse the repository at this point in the history

  2. specify DAG to use Airflow 1 operators

    @adlersantos
    adlersantos committed Aug 13, 2021
    Configuration menu
    Copy the full SHA
    6a02634 View commit details
    Browse the repository at this point in the history