LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit

Nov 1, 2024·

Ruihao Gong

Ruihao Gong

* Equal Contribution

,

Yang Yong

* Equal Contribution

,

Shiqiao Gu

* Equal Contribution

,

Yushi Huang

* Equal Contribution

,

Chengtao Lv

,

Yunchen Zhang

,

Dacheng Tao

,

Xianglong Liu

· 0 min read

Type

Conference paper

Publication

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track

Last updated on Nov 1, 2024

Ruihao Gong

Authors

← Towards Efficient LLM Inference via Collective and Adaptive Speculative Decoding Jan 1, 2025

Fast and Controllable Post-training Sparsity: Learning Optimal Sparsity Allocation with Global Constraint in Minutes Jun 1, 2024 →