Skip to content

siaarzh/spark-docker-swarm

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Running Spark with Docker Swarm on DigitalOcean

Want to learn how to build this?

Check out the post.

Want to use this project?

  1. Fork/Clone

  2. Sign up for Digital Ocean and generate an access token

  3. Add the token to your environment:

    $ export DIGITAL_OCEAN_ACCESS_TOKEN=[your_token]
  4. Spin up three droplets and deploy Docker Swarm:

    $ sh scripts/create.sh
  5. Run the script:

    $ sh scripts/run.sh
  6. Bring down the resources:

    $ sh scripts/destroy.sh

About

running apache spark with docker swarm

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Shell 78.1%
  • Python 21.9%