Pinned

1. llama.cpp llama.cpp Public

   Forked from ggerganov/llama.cpp

   Port of Facebook's LLaMA model in C/C++

   C++

2. neural-speed neural-speed Public

   Forked from intel/neural-speed

   An innovation library for efficient LLM inference via low-bit quantization and sparsity

   C++

3. intel-extension-for-transformers intel-extension-for-transformers Public

   Forked from intel/intel-extension-for-transformers

   ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

   Python

4. neural-compressor neural-compressor Public

   Forked from intel/neural-compressor

   Provide unified APIs for SOTA model compression techniques, such as low precision (INT8/INT4/FP4/NF4) quantization, sparsity, pruning, and knowledge distillation on mainstream AI frameworks such as…

   Python