Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models

Xiuying Wei, Yunchen Zhang, Xiangguo Zhang, Ruihao Gong, Shanghang Zhang, Qi Zhang, Fengwei Yu, Xianglong Liu
September, 2022
PDF Cite URL
Type
Conference paper
Publication
Thirty-Sixth Conference on Neural Information Processing Systems
Ruihao Gong
Ruihao Gong

My research interests include deep learning fundamental, efficient AI, and their relevant applications such as autonomous driving and AIoT.