Skip to content

This project is solution of exercise Big Data Tools For Physics Analysis for CERN-HSF GSoC 2017

Notifications You must be signed in to change notification settings

shivanshuiitg/CERN-Big-data-project-POC-

Repository files navigation

CERN-Big-data-project

This is a proof of concept of how Big data tools for Physics Analysis can be implemented in GSoC-2017.

  • This project has been made and tested on Spark-1.6.3
  • Go to directory, where you cloned this repositry.
  • Execute command from terminal, jupyter notebook

Environment Variable settings:-

Add these lines (with directory name changed as per your system) to your .bashrc file.

export SPARK_HOME="/home/shivanshu/Documents/SPARK-1/spark-1.6.3-bin-hadoop2.6"
export PATH=$PATH:$SPARK_HOME/bin
export PYTHONPATH=$SPARK_HOME/python/:$PYTHONPATH
export PYTHONPATH=$SPARK_HOME/python/lib/py4j-0.9-src.zip:$PYTHONPATH