GitHub - aroraayush/airflow-spark-stackoverflow-logs-analysis: Ask Ubuntu Logs analysis with PySpark on GCP | Pipeline with Airflow (Cloud Composer)

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
01a User Extraction.ipynb		01a User Extraction.ipynb
01b Comments User Join.ipynb		01b Comments User Join.ipynb
02 Trend Users (Users with max comments).ipynb		02 Trend Users (Users with max comments).ipynb
02 data_studio_user_trends.png		02 data_studio_user_trends.png
02 user_trends.png		02 user_trends.png
03 Trending Topics in Comments.ipynb		03 Trending Topics in Comments.ipynb
03 Trending_topics.png		03 Trending_topics.png
03 Trending_topics_data_studio.png		03 Trending_topics_data_studio.png
03 stopwords.txt		03 stopwords.txt
04 Airflow_main_dag.py		04 Airflow_main_dag.py
04a user.py		04a user.py
04b user_comments_join.py		04b user_comments_join.py
Final project.pdf		Final project.pdf
Posts.ipynb		Posts.ipynb
Project 4 _ Stack Overflow - askubuntu dataset.pdf		Project 4 _ Stack Overflow - askubuntu dataset.pdf
index.html		index.html

About

Ask Ubuntu Logs analysis with PySpark on GCP | Pipeline with Airflow (Cloud Composer)

ayusharora.me/stackoverflow-ask-ubuntu-spark-analysis/

airflow spark ubuntu stackoverflow batch-processing askubuntu cloudcomposer log-processing

Report repository

Languages

HTML 99.0%
Other 1.0%