Cast Iron

The platform-agnostic data storage and ETL system leveraging MinIO and other tools to enable mission end states.

This repository contains the docker-compose recipe for staring up the backbone of Cast-Iron as well as the Cast-Iron Worker.

Main Parts of the system include:

• Object Storage (AWS S3, MinIO, etc.)
• Message Queue (Kafka, Nats, etc.)
• Worker (Celery, Faust, etc.)
• ETL (Bash Scripts, Python)

Getting Started

• Install Docker
• Create a startup script within your existing project that you would like to use Cast-Iron with. See cast-iron-recipe-postgres for an example of this.
• Clone this repository as a submodule within your existing repository with git submodule add git@github.com:black-cape/cast-iron-docker-compose.git

Once started, the following areas are accessible:

• MinIO at localhost:9000
• PostgreSQL
  • User: castiron
  • Password: castiron
  • Host: localhost
  • Port: 5432
  • Database: castiron