Pinned

1. intel/neural-compressor intel/neural-compressor Public

   SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

   Python 2k 240

2. EleutherAI/lm-evaluation-harness EleutherAI/lm-evaluation-harness Public

   A framework for few-shot evaluation of language models.

   Python 5.3k 1.4k

3. intel/intel-extension-for-transformers intel/intel-extension-for-transformers Public

   ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

   Python 2k 188

4. optimum optimum Public

   Forked from huggingface/optimum

   🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

   Python

5. optimum-intel optimum-intel Public

   Forked from huggingface/optimum-intel

   Accelerate inference of 🤗 Transformers with Intel optimization tools

   Python

6. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

   Python