CerebralCortex

Coding Guidelines

Please utilize https://www.python.org/dev/peps/pep-0008/ for coding guides. IntelliJ defaults to this style for python as well.

Intellij Setup

Environment Variables in Run Configuration

• PYTHONPATH=/Users/hnat/Downloads/spark-2.0.2-bin-hadoop2.7/python:/Users/hnat/Downloads/spark-2.0.2-bin-hadoop2.7/python/lib/py4j-0.10.3-src.zip
• SPARK_HOME=/Users/hnat/Downloads/spark-2.0.2-bin-hadoop2.7/
• PYSPARK_SUBMIT_ARGS=--conf spark.cassandra.connection.host=127.0.0.1 --packages com.datastax.spark:spark-cassandra-connector_2.11:2.0.0-M3 pyspark-shell

Add pyspark.zip to your project libraries:

http://stackoverflow.com/questions/13994846/intellij-python-plugin-run-classpath

• Go to File -> Project Structure
• Now select Modules and then "Dependencies" tab
• Click the "+" icon and select "Library"
• Click "New Library" and select Java (I know it's weird...)
• Now choose multiple modules / egg and "OK".
• Select "Classes" from categories.
• Give your new library a name, "My Python not Java Library"
• And finally click "Add Selected"