OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

Local LLama3 Inference with OpenVINO

A unified multi-backend utility for benchmarking Transformers, Timm, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

Deep Learning Inference benchmark. Supports OpenVINO™ toolkit, Caffe, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apache TVM, ncnn, etc.

An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.

Neural Network Compression Framework for enhanced OpenVINO™ inference

📚 Jupyter notebook tutorials for OpenVINO™

Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet and more!)

Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™

nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为基础，致力为用户提供跨平台、简单易用、高性能的模型部署体验。

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

Software Development Kit (SDK) for the Intel® Geti™ platform for Computer Vision AI model training.

A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.

Repository for OpenVINO's extra modules

Go package for computer vision using OpenCV 4 and beyond. Includes support for DNN, CUDA, and OpenCV Contrib.

A scalable inference server for models optimized with OpenVINO™

Pre-trained Deep Learning models and demos (high quality and extremely fast)

Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVION and PaddlePaddle.

OpenMMLab Model Deployment Framework