MLOps Toys

A collection of MLOps Pipeline toys (templates for how to do things) for creating standard pipelines.

Most of these will be contained to a single folder. The README in that folder will explain what the pipeline is.

Current Toys

• ✅ Working.
• 🚧 In Progress.
• ❌ Not Working.

---

• ✅ apis :: fastapi_example
• ✅ credential_mgmt :: sops
• ✅ data_build_tools :: dbt_pg
• ✅ data_frontend :: streamlit
• ✅ data_generators :: clf_log_generator
• ✅ data_generators :: flog
• ✅ data_logging :: whylogs
• ✅data_platforms :: mlflow
• ✅ data_processing :: pyspark
• ✅ databases :: duckdb
• ✅ databases :: mysql
• ✅ databases :: pg
• ✅ databases :: redis
• ✅ databases :: trino
• ✅ doc_styles :: diataxis
• ✅ ds_models :: utils
• ✅ graphql :: strawberry_graphql
• 🚧 local_dev :: localstack
• 🚧 logging :: grafana
• 🚧 logging :: prometheus
• ✅ model_explanation :: shap
• ✅ orchestration_tools :: airflow
• ✅ streaming :: kafka_consumer_producer
• ✅ streaming :: kinesis_streaming
• ✅ terraform_template :: _template

Making a New Toy

The only requirements are:

• The folder must contain a README made from README.md.tmpl.

• The folder must have one of the following (if applicable):

  • Dockerfiles or a docker-compose.yaml

  • Terraform-related files

  • Helm-related files