Get up and running with Llama 3, Mistral, Gemma, and other large language models.

🤯 Lobe Chat - an open-source, modern-design ChatGPT/LLMs UI/Chat Framework. Supports speech-synthesis, multi-modal, and extensible plugin system. One-click FREE deployment of your private ChatGPT/Gemini/Ollama chat application.

This repository lists some awesome public Rust projects, Videos, Blogs and Jobs.

A collection of some awesome public Mojo🔥 programming language and Multi-Level IR Compiler Framework(MLIR) projects.

🚀🚀🚀A collection of some awesome public projects about Large Language Model, Vision Foundation Model and AI Generated Content.

🤘 TT-NN operator library, and TT-Metalium low level kernel programming model.

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

NAACL '24 (Demo) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference

ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 35+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, Deepseek, ...)

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

A high-throughput and memory-efficient inference and serving engine for LLMs

🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Unify Efficient Fine-Tuning of 100+ LLMs

🤖 Collect practical AI repos, tools, websites, papers and tutorials on AI. 实用的AI百宝箱 💎

LLM inference in C/C++

Make your own story. User-friendly software for LLM roleplaying

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

VSCode coding companion for software teams 🦆 Turn your team insights into a portable plug-and-play context for code generation. Alternative to GitHub Copilot & OpenAI GPT powered by OSS LLMs (Phi 3, Llama 3, CodeQwen, Mistral, etc.), made with ❤️ using FastAPI & Ollama.

Java version of LangChain