The platform-agnostic data storage and ETL system leveraging MinIO and other tools to enable mission end states.
This repository contains the docker-compose recipe for staring up the backbone of Cast-Iron as well as the Cast-Iron Worker.
Main Parts of the system include:
- Object Storage (AWS S3, MinIO, etc.)
- Message Queue (Kafka, Nats, etc.)
- Worker (Celery, Faust, etc.)
- ETL (Bash Scripts, Python)
- Install Docker
- Create a startup script within your existing project that you would like to use Cast-Iron with.
See
cast-iron-recipe-postgres
for an example of this. - Clone this repository as a submodule within your existing repository with
git submodule add git@github.com:black-cape/cast-iron-docker-compose.git
Once started, the following areas are accessible:
- MinIO at localhost:9000
- PostgreSQL
- User: castiron
- Password: castiron
- Host: localhost
- Port: 5432
- Database: castiron