A Survey of Low-bit Large Language Models: Basics, Systems, and Algorithms

Jan 1, 2025·

Ruihao Gong

,

Yifu Ding

,

Zining Wang

,

Chengtao Lv

,

Xingyu Zheng

,

Jinyang Du

,

Yang Yong

,

Shiqiao Gu

,

Haotong Qin

,

Jinyang Guo

,

Dahua Lin

,

Michele Magno

,

Xianglong Liu

· 0 min read

Cite DOI URL

Large Language Model Quantization Low-Bit System Algorithm

Authors

Ruihao Gong

---

← AtomNet: Designing Tiny Models from Operators Under Extreme MCU Constraints Apr 1, 2025

DA-KD: Difficulty-Aware Knowledge Distillation for Efficient Large Language Models Jan 1, 2025 →