Skip to content
This repository has been archived by the owner on Sep 17, 2021. It is now read-only.

ECS deploy #1054

Open
wants to merge 5 commits into
base: develop
Choose a base branch
from
Open

ECS deploy #1054

wants to merge 5 commits into from

Conversation

tabletcorry
Copy link
Contributor

@tabletcorry tabletcorry commented May 2, 2018

Basically, I tease the existing docker-compose file into three parts, for the major services that need to run in production. In order to function, the env files need to specify all the required variables in the new yaml files. I will document this.

This isn't perfect. An alternative solution would be to build the component compose files "on-the-fly" by parsing the base compose YAML. That may be the evolution of this change, but I wanted to prove out the basic ECS deployment.

Comments very welcome. I don't think this is merge-worth just yet, so I am interested in thoughts from the SM maintainers.

Changes:

  • Add individual docker compose files for ECS Compose tooling
  • Add script to deploy code to ECS
  • Make all docker init scripts exit on failure (to prevent zombie containers)
  • More env vars!

Todo:

  • Document new vars required
  • Add scripts to create ECS services

@coveralls
Copy link

coveralls commented May 2, 2018

Coverage Status

Coverage decreased (-0.007%) to 72.427% when pulling 4a64080 on tabletcorry:ecs_deploy into adfe606 on Netflix:develop.

@mikegrima
Copy link
Contributor

Will be very interested in the docs.

@badllama
Copy link

I'm definitely looking into an ECS Fargate deployment. Any chance for further progress on this PR?

@ollytheninja
Copy link
Contributor

I have Security Monkey running on ECS in prod based on this PR so I'll have a dig tomorrow and see if I made any major changes

@tabletcorry
Copy link
Contributor Author

I never pursued the Fargate changes @badllama, as the ECS deployment was functional and cheaper.

@ollytheninja 🎉

@tabletcorry
Copy link
Contributor Author

The only missing item is a script to create the ECS services/cluster. But I don't have the time to create that now.

@mikegrima I am fine with this being merged now, especially since it worked for @ollytheninja. But I leave it up to you.

@tabletcorry tabletcorry changed the title WIP: ECS deploy ECS deploy Jan 16, 2019
@mikegrima
Copy link
Contributor

Can you do me a favor and rebase it with the latest develop?

- Add env var for celery worker count
- Remove blank AWS keys from env (confuses ECS)
- Add ecs_push script for updating ECS env
- Modify docker start scripts to crash on error
- Add docker compose files for each service set
-
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants