This is a spark learning demo, including rdd, transform, action, sparkSQL,dataframe, hdfs and mllib I can update the demo irregularly.
spark: 2.2.0-hadoop-2.7.0 hadoop: 2.7.0 scala: 2.1.1 jdk: 1.8 hive: 2.1.1 hbase: 1.1.11 sbt: 2.13.6
The Main.scala is the main input of this project, and in the Main, there are many call demo we can use, such as rdd(transform and zaction), sparksql(txt, json, csv, hive), and mllib so on.