This is the official PyTorch implementation of "LLM-QBench: A Benchmark Towards the Best Practice for Post-training Quantization of Large Language Models", and also an efficient LLM compression tool with various advanced compression methods, supporting multiple inference backends.

A platform that helps you deploy services with one click.

The DevEx & Application-layer for your Internal Developer Platform ⛵

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Ephemeral HashiCorp Vault Server (raft backend) TLS / PKI Engine for testing and learning

Application Delivery as Code that Runs Anywhere

A tool to simplify workflows using fully typed JavaScript for your favorite CI/CD services

Watch k8s Resources to fix self propagation check for clusters behind NAT

CDK Construct for deploying a webapp release

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

Incometric predicts income using machine learning on demographic and socio-economic data. It involves data preprocessing, feature engineering, model training, evaluation, and deployment. This tool aids financial planning and policy-making, offering accurate predictions through a web application and API.

The lightweight Docker Compose deployment runner.

💬 The Step-by-Step Beginners Tutorial for Building, Testing & Deploying a Chat app in Phoenix 1.7 [Latest] 🚀

The developer framework for your data & analytics stack

Windows 11 image script

🚀 The easiest way to automate building and releasing your iOS and Android apps

Sell-Your-Saas is an Open Source solution to automate and sell any Web application as a SaaS service

开源自部署移动应用、 macOS、Linux 和 Windows 应用分发平台，提供 iOS、Android SDK、fastlane 等丰富组件库 | Self-hosted Beta App Distribution for Android, iOS, macOS, Linux and Windows apps

A universal scalable machine learning model deployment solution

Chef Infra, a powerful automation platform that transforms infrastructure into code automating how infrastructure is configured, deployed and managed across any environment, at any scale