SatLight / Airline-Delay-Prediction-using-Spark-and-Kylin Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Building a prediction model for a huge dataset using Big Data tech like Kylin and Spark.

GPL-3.0 license

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
LICENSE		LICENSE
PySpark.ipynb		PySpark.ipynb
README.md		README.md
mapper.py		mapper.py
reducer.py		reducer.py

Repository files navigation

Airline-Delay-Prediction-using-Spark-and-Kylin

Mapper and Reducer purpose is to detect and replace null values by column average.

The model is built in PySpark using Decision Tree Classifiers.

About

Building a prediction model for a huge dataset using Big Data tech like Kylin and Spark.

spark hive hadoop kylin hadoop-mapreduce

GPL-3.0 license

Report repository

Releases

No releases published

Packages

No packages published

Languages