A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

The repository provides docs & api & tutorials & FAQ and all things like that.

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

A high-throughput and memory-efficient inference and serving engine for LLMs

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

長門櫻 Discord 機器人 Python 版本

Unofficial PyTorch implementation of Denoising Diffusion Probabilistic Models

NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite

A practical method for training energy-based language models.

MOT using deepsort and yolov3 with pytorch

AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

Function unified C/C++ API for running Python functions on desktop, mobile, web, and in the cloud. Register at https://fxn.ai

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

Deep Learning for humans

Large Language Model Text Generation Inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.