Global Temperatures and Health Database

This project creates a database consisting of Global Temperature and Health Statistics data ranging from the mid-18th century to 2015. The database is hosted on BigQuery in GCP and was created via Beam pipelines with a workflow automated through Airflow. A description of the database is included in DATASETS.txt as well as a breakdown of the project in slides.pdf.

Colin Phillips, clp3299, colinphillips@utexas.edu

Adnan Desai, ayd265, adnandesai@utexas.edu

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
CROSS-DATASETS.txt		CROSS-DATASETS.txt
City_beam.py		City_beam.py
City_beam_dataflow.py		City_beam_dataflow.py
Country_beam.py		Country_beam.py
Country_beam_dataflow.py		Country_beam_dataflow.py
DATASETS.txt		DATASETS.txt
Health_Statistics_beam.py		Health_Statistics_beam.py
Health_Statistics_beam_dataflow.py		Health_Statistics_beam_dataflow.py
Life_Statistics_beam.py		Life_Statistics_beam.py
Life_Statistics_beam_dataflow.py		Life_Statistics_beam_dataflow.py
Population_Statistics_beam.py		Population_Statistics_beam.py
Population_Statistics_beam_dataflow.py		Population_Statistics_beam_dataflow.py
README.md		README.md
State_beam.py		State_beam.py
State_beam_dataflow.py		State_beam_dataflow.py
TRANSFORMS.txt		TRANSFORMS.txt
Urban_Growth_Statistics_beam.py		Urban_Growth_Statistics_beam.py
Urban_Growth_Statistics_beam_dataflow.py		Urban_Growth_Statistics_beam_dataflow.py
college_ingest.ipynb		college_ingest.ipynb
cross_dataset_analysis.ipynb		cross_dataset_analysis.ipynb
dashboard-final.pdf		dashboard-final.pdf
dashboard-v1.pdf		dashboard-v1.pdf
dashboard-v2.pdf		dashboard-v2.pdf
erd-unified.pdf		erd-unified.pdf
input.txt		input.txt
kaggle2_injest.ipynb		kaggle2_injest.ipynb
kaggle2_modeled.ipynb		kaggle2_modeled.ipynb
kaggle2_workflow.py		kaggle2_workflow.py
kaggle_analysis.ipynb		kaggle_analysis.ipynb
kaggle_erd_beam.pdf		kaggle_erd_beam.pdf
kaggle_erd_modeled.pdf		kaggle_erd_modeled.pdf
kaggle_erd_staging.pdf		kaggle_erd_staging.pdf
kaggle_erd_staging_queries.ipynb		kaggle_erd_staging_queries.ipynb
kaggle_injest.ipynb		kaggle_injest.ipynb
kaggle_joins.ipynb		kaggle_joins.ipynb
kaggle_modeled.ipynb		kaggle_modeled.ipynb
output.txt		output.txt
schema.json		schema.json
slides.pdf		slides.pdf

colinphil/global-temperatures-health-database

Folders and files

Latest commit

History

Repository files navigation

Global Temperatures and Health Database

About

Topics

Resources

Stars

Watchers

Forks

Languages