Telegram bot that uses preset prompts to help users communicate like native English speakers.

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 35+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, Deepseek, Baichuan2...)

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

Unify Efficient Fine-Tuning of 100+ LLMs

大模型LLM系列 课程资料

Easy "1-line" calling of all LLMs from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama

Bot en telegram con IA de llama 2 and llama 3

Repo for DermAssist: Your AI Assitant for Skin Problems. Powered by a vision model and a reliable RAG system.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

jetson-examples running AI models and applications on NVIDIA Jetson devices with one-line command.

Raycast extension to use GPT-4, Llama-3, and more... all for FREE. No API Key required!

Fluent CLI is an advanced command-line interface designed to interact seamlessly with multiple workflow systems like FlowiseAI, Langflow, Make, and Zapier. Tailored for developers and IT professionals, Fluent CLI facilitates robust automation, simplifies complex interactions, and enhances productivity through a powerful and command suite

A lightweight, fast, parallel inference server for Llama

LlamaIndex is a data framework for your LLM applications

🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

A high-performance inference system for large language models, designed for production environments.

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory