ggml
Here are 75 public repositories matching this topic...
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
-
Updated
Jun 2, 2024 - Python
Stable Diffusion in pure C/C++
-
Updated
Jun 1, 2024 - C++
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
-
Updated
May 29, 2024 - C++
Whisper Dart is a cross platform library for dart and flutter that allows converting audio to text / speech to text / inference from Open AI models
-
Updated
May 2, 2024 - C++
Run inference on replit-3B code instruct model using CPU
-
Updated
Jul 5, 2023 - Python
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
-
Updated
Nov 4, 2023 - JavaScript
Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
-
Updated
Aug 8, 2023 - C++
CLIP inference in plain C/C++ with no extra dependencies
-
Updated
Feb 12, 2024 - C
🪶 Lightweight OpenAI drop-in replacement for Kubernetes
-
Updated
Feb 5, 2024 - Python
Inference Vision Transformer (ViT) in plain C/C++ with ggml
-
Updated
Apr 11, 2024 - C++
workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg
-
Updated
Jun 2, 2024 - C++
Improve this page
Add a description, image, and links to the ggml topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ggml topic, visit your repo's landing page and select "manage topics."