Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!

Model Deployment at Scale on Kubernetes 🦄️

Pybind11 bindings for Whisper.cpp

All the available resources to master MLOPS from scratch

BentoML Example Projects 🎨

A simple web application that lets you replace any part of an image with an image generated based on your description.

This repository contains instructions, template source code and examples on how to serve/deploy machine learning models using various frameworks and applications such as Docker, Flask, FastAPI, BentoML, Streamlit, MLflow and even code on how to deploy your machine learning model as an android app.

Analyzes your GitHub Profile and presents you with a report on how likely you are to become the next MLH Fellow!

A bentoML-powered API to transcribe audio and make sense of it

My repo for the Machine Learning Engineering bootcamp 2022 by DataTalks.Club

A simple yet complete guide to MLOps tools and practices - from a conventional way to a modern approach of working with ML projects.

Generate novel text - novel finetuned from skt KoGPT2 base v2 - 한국어

End to End MLOps

API serving for your diffusers models

🏛 ML Inference Pipeline for Legist

DKT Project Served by Airflow / BentoML / Docker Swarm

MLOps Implementing "Brain Computer Interface" on Kubernetes

Helm Chart for installing Yatai on Kubernetes ⎈

Deploying machine learning model using 10+ different deployment tools