fugue-demo

An introduction to coding spark jobs with fugue library

Dependencies

This notebook has to run on a server with access to a spark cluster

Installation

conda env create -f environment.yml

Note you'll need to create a local output folder in the repo root path.