TFM_MUINBDES

Final thesis of my Master's degree (Business Intelligence and Big Data in Cyber-Secure Environments)

Content

• Description
• Main process schema
• Data sources
• Technologies
• Folders structure
• Previews
  • Map
  • NO2 2018 average
• License
• Author

Description

Development of an environment model for the analysis of air pollution/air quality levels in Madrid, which allows information to be better exploited by control stations distributed in different parts of the city. Both the ingestion, processing, exploitation and visualization of the data are contemplated, to answer analytical questions on the selected subject. You can visit the results website here (Sorry, only available in Spanish due to academic purposes).

Main process schema

Data sources

• Main data source: datos.madrid

Technologies

• Data preparation, cleaning, and transformation

  • Python
  • R
  • Jupyter notebooks

• Main visualization

  • Power BI

• Other used tools

  • Vega
  • DataWrapper
  • Tinybird

Folders structure

└───|- /Code
│        └─── /data
│          └─── /daily_data
│          └─── /hourly_data
│          └─── /control_stations_data
│
│        └─── /air_quality_stations
│          └─── /formatted_data
│          |-- calidad_aire_estaciones.ipynb
│
│        └─── /air_quality_python_analysis 
│          └─── /formatted_data
│          |-- calidad_aire.py
│          |-- merge_data_calidad_aire.ipynb
│
│        └─── /air_quality_R_analysis
│          └─── /formatted_data
│          |-- calidad_aire.R
│
│        |-- README.md (code)
│ 
└───|- /Data Visualization
│
│        └─── /PowerBi
│
│        |-- README.md (data visualization)
│ 
└───|- /Documentation
│        └─── /latex
│        └─── /slides (presentation)
│        └─── /images (for the main README)
│
│        |-- README.md (documentation)
│ 
└───|- /Information
│        └─── /Official Documents
│
│        |-- README.md (information)
│ 
└───|- /docs
│        └─── /assets
│        └─── /images
│
│        |-- index.html 
│        |-- README.md (github pages/landing page with some results)
│     
│-- LICENSE.md
│-- README.md (main)

Previews

Madrid control stations location

You can interact with the map here.

NO2 average for 2018

License

This project is licensed under the MIT License - see the LICENSE file for details. Copyright (c) 2019 Adrián.

Author

Adrián Aguado - feel free to contact me!