Skip to content

Spark practice from CSED426, fall 2018, at POSTECH

Notifications You must be signed in to change notification settings

wldh-ug/CSED426_SparkPractice

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Assignment#2 Spark

I used Spark 2.2.0 following HW2 instruction document.

How to compile and test

Launching HDFS and YARN using start-dfs.sh and start-yarn.sh as you did in HW1, you can follow below to run my code.

$ make test

This will build KMeans.jar and automatically run jar in your Spark system and compare the result with standard result (provided by TA).

For more information, you can type make help for full command list.