Quantization

A Survey of Low-bit Large Language Models: Basics, Systems, and Algorithms

Jan 1, 2025

MQBench
MQBench

An open-source model quantization toolkit based on PyTorch fx.

Jul 27, 2021