Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models

Sep 27, 2022·

Xiuying Wei

,

Yunchen Zhang

,

Xiangguo Zhang

Ruihao Gong

Ruihao Gong

,

Shanghang Zhang

,

Qi Zhang

,

Fengwei Yu

,

Xianglong Liu

· 0 min read

Type

Conference paper

Publication

Thirty-Sixth Conference on Neural Information Processing Systems

Last updated on Oct 9, 2022

Ruihao Gong

Authors

← Distribution-Sensitive Information Retention for Accurate Binary Neural Network Oct 1, 2022

Generating Transferable Adversarial Examples against Vision Transformers Jan 1, 2022 →