A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.

The simplest way to serve AI/ML models in production

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

🔀 Bedrock Proxy Endpoint ⇢ Spin up your own custom OpenAI API server endpoint for easy AWS Bedrock inference (using standard baseUrl, and apiKey params)

Unofficial (Golang) Go bindings for the Hugging Face Inference API

Eternal is an experimental platform for machine learning models and workflows.

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

Text to image generation with stable diffusion xl model powered by hugging face inference api

LeapfrogAI API

Text components powering LLMs & SLMs for geniusrise framework

Train and predict your model on pre-trained deep learning models through the GUI (web app). No more many parameters, no more data preprocessing.

An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate human readable conversational response with the help of LLM (Large Language Model).

Tool for test diferents large language models without code.

MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.

Depth Inference API built using Sanic and the MiDaS v2.7 Small Model in ONNX format

Background Removal and Replacement API built using the Sanic Framework

A Non-Official HuggingFace Rest Client for Unity (UPM)