Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Onboard Google Diversity Annual Report 2021 dataset #111

Merged
merged 22 commits into from Jun 28, 2021
Merged

feat: Onboard Google Diversity Annual Report 2021 dataset #111

merged 22 commits into from Jun 28, 2021

Commits on May 26, 2021

  1. jinja template for backend.tf

    @adlersantos
    adlersantos committed May 26, 2021
    Configuration menu
    Copy the full SHA
    1546e82 View commit details
    Browse the repository at this point in the history

  2. template path for backend.tf

    @adlersantos
    adlersantos committed May 26, 2021
    Configuration menu
    Copy the full SHA
    c316d30 View commit details
    Browse the repository at this point in the history

  3. add backend.tf file generation in generate_terraform.py script

    @adlersantos
    adlersantos committed May 26, 2021
    Configuration menu
    Copy the full SHA
    cac78fe View commit details
    Browse the repository at this point in the history

  4. refactor create file function to be selective of dir tree

    @adlersantos
    adlersantos committed May 26, 2021
    Configuration menu
    Copy the full SHA
    15ad8f5 View commit details
    Browse the repository at this point in the history

  5. fixed backend.tf template with missing quotes

    @adlersantos
    adlersantos committed May 26, 2021
    Configuration menu
    Copy the full SHA
    d62196b View commit details
    Browse the repository at this point in the history

  6. revised generate_terraform tests to account for remote state file

    @adlersantos
    adlersantos committed May 26, 2021
    Configuration menu
    Copy the full SHA
    6c2b341 View commit details
    Browse the repository at this point in the history

  7. rerun generate terraform files for ml_datasets

    @adlersantos
    adlersantos committed May 26, 2021
    Configuration menu
    Copy the full SHA
    92054af View commit details
    Browse the repository at this point in the history

  8. updated README for TF remote state usage

    @adlersantos
    adlersantos committed May 26, 2021
    Configuration menu
    Copy the full SHA
    f7c8af7 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2021

  1. Merge branch 'main' into dar-dataset

    @adlersantos
    adlersantos committed Jun 3, 2021
    Configuration menu
    Copy the full SHA
    ef81b79 View commit details
    Browse the repository at this point in the history

  2. feat: Onboard Google's Diversity Annual Report dataset

    @adlersantos
    adlersantos committed Jun 3, 2021
    Configuration menu
    Copy the full SHA
    0c1f5e3 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2021

  1. Merge branch 'main' into dar-dataset 

    # Conflicts:
#	tests/scripts/test_generate_terraform.py
    @adlersantos
    adlersantos committed Jun 18, 2021
    Configuration menu
    Copy the full SHA
    ca79b58 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2021

  1. feat: column descriptions

    @adlersantos
    adlersantos committed Jun 21, 2021
    Configuration menu
    Copy the full SHA
    b98afaf View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2021

  1. BQ table descriptions

    @adlersantos
    adlersantos committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    7b3ef0d View commit details
    Browse the repository at this point in the history

  2. regenerate BQ table descriptions on .tf files

    @adlersantos
    adlersantos committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    f9f4c55 View commit details
    Browse the repository at this point in the history

  3. Update datasets/google_dei/diversity_annual_report/pipeline.yaml 

    Co-authored-by: Leah E. Cole <6719667+leahecole@users.noreply.github.com>
    @adlersantos @leahecole
    adlersantos and leahecole committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    09dd3e0 View commit details
    Browse the repository at this point in the history

  4. Update datasets/google_dei/diversity_annual_report/pipeline.yaml 

    Co-authored-by: Leah E. Cole <6719667+leahecole@users.noreply.github.com>
    @adlersantos @leahecole
    adlersantos and leahecole committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    f335113 View commit details
    Browse the repository at this point in the history

  5. use self_id instead of selfid

    @adlersantos
    adlersantos committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    f62590a View commit details
    Browse the repository at this point in the history

  6. Merge branch 'dar-dataset' of github.com:GoogleCloudPlatform/public-d… 

    …atasets-pipelines into dar-dataset
    @adlersantos
    adlersantos committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    11806e8 View commit details
    Browse the repository at this point in the history

  7. regenerated the DAG

    @adlersantos
    adlersantos committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    91a5886 View commit details
    Browse the repository at this point in the history

  8. Update datasets/google_dei/diversity_annual_report/pipeline.yaml 

    Co-authored-by: Leah E. Cole <6719667+leahecole@users.noreply.github.com>
    @adlersantos @leahecole
    adlersantos and leahecole committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    4ec522f View commit details
    Browse the repository at this point in the history

  9. Update datasets/google_dei/diversity_annual_report/pipeline.yaml 

    Co-authored-by: Leah E. Cole <6719667+leahecole@users.noreply.github.com>
    @adlersantos @leahecole
    adlersantos and leahecole committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    f96be72 View commit details
    Browse the repository at this point in the history

  10. regenerated the DAG

    @adlersantos
    adlersantos committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    0ea9f65 View commit details
    Browse the repository at this point in the history