MQBench

MQBench

MQBench is an open-source model quantization toolkit based on PyTorch fx.

The envision of MQBench is to provide:

  • SOTA Algorithms. With MQBench, the hardware vendors and researchers can benefit from the latest research progress in academia.
  • Powerful Toolkits. With the toolkit, quantization node can be inserted to the original PyTorch module automatically with respect to the specific hardware. After training, the quantized model can be smoothly converted to the format that can inference on the real device.

The documentation can be seen at Documentation and the website is at Link.

Ruihao Gong
Ruihao Gong
Associate Research Director of Artificial Intelligence

My research interests include deep learning fundamental, efficient AI, and their relevant applications such as autonomous driving and AIoT.