feat: Onboard San francisco 311 service requests #184

nlarge-google · 2021-09-14T17:44:17Z

Checklist

Note: Delete items below that aren't applicable to your pull request.

Please merge this PR for me once it is approved.
If this PR adds or edits a dataset or pipeline, it was reviewed and approved by the Google Cloud Public Datasets team beforehand.
If this PR adds or edits a dataset or pipeline, I put all my code inside datasets/san_francisco_311_service_requests> and nothing outside of that directory.
This PR is appropriately labeled.

…ng DAG

…resolve broken quotes errors when inserting into bigquery

datasets/san_francisco_311_service_requests/_images/run_csv_transform_kub/Dockerfile

datasets/san_francisco_311_service_requests/_images/run_csv_transform_kub/csv_transform.py

nlarge-google · 2021-09-30T20:41:41Z

@adlersantos I have completed changes as directed. Please review. Thanks!

nlarge-google added 3 commits September 11, 2021 04:44

feat: san-francisco 311 Service Requests - Untested do not use

724c824

fix: runs locally

bd8dbda

fix: resolved flake8 issues

690dfd1

google-cla bot added the cla: yes label Sep 14, 2021

nlarge-google added 4 commits September 14, 2021 17:55

fix: yamllint errors fix to pipeline.yaml

43a4c9d

fix: attempted fix at resolving jinja error in airflow 2 when executi…

c1e06dc

…ng DAG

fix: fixed jinja error in airflow 2 when executing DAG

a454880

fix: works in airflow2

6336126

nlarge-google assigned adlersantos Sep 15, 2021

nlarge-google requested a review from adlersantos September 15, 2021 19:23

nlarge-google added 3 commits September 22, 2021 21:25

fix: added allow_quoted_newlines=True to pipeline.yaml to attempt to …

65f59cc

…resolve broken quotes errors when inserting into bigquery

fix: resolved casting issue. Now runs successfully in Airflow

7389d49

fix: resolved flake8 issue. Now runs successfully in Airflow

d81ad1d

adlersantos requested changes Sep 29, 2021

View reviewed changes

nlarge-google added 2 commits September 30, 2021 20:31

fix: resolve code review points as per PR. Plus cleanup

9fa6367

fix: resolve flake8 issues

8b0f4ba

adlersantos approved these changes Oct 6, 2021

View reviewed changes

adlersantos merged commit a8ba2e9 into GoogleCloudPlatform:main Oct 6, 2021