A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap

☁️ Build multimodal AI applications with cloud-native stack

A high-throughput and memory-efficient inference and serving engine for LLMs

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!

本项目旨在分享大模型相关技术原理以及实战经验。

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

Add memory, knowledge and tools to LLMs

🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.

🪢 Open source LLM engineering platform. Observability, metrics, evals, prompt management, testing, prompt playground, datasets, LLM evaluations -- 🍊YC W23 🤖 integrate via Typescript, Python / Decorators, OpenAI, Langchain, LlamaIndex, Litellm, Instructor, Mistral, Perplexity, Claude, Gemini, Vertex

🐢 Open-Source Evaluation & Testing framework for LLMs and ML models

An awesome & curated list of best LLMOps tools for developers

Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.

AI Observability & Evaluation

LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,⚡in sync with your data sources.