Hierarchical Balance Packing: Towards Efficient Supervised Fine-tuning for Long-Context LLM

Jan 1, 2025·

Yongqiang Yao

,

Jingru Tan

,

Kaihuan Liang

,

Feizhao Zhang

,

Jiahao Hu

,

Shuo Wu

,

Yazhe Niu

Ruihao Gong

📧 Corresponding Author

,

Dahua Lin

,

Ningyi Xu

📧 Corresponding Author

· 0 min read

PDF Cite Code

Authors

Ruihao Gong

---

← HarmoniCa: Harmonizing Training and Inference for Better Feature Caching in Diffusion Transformer Acceleration Jan 1, 2025

OMNIBAL: Towards Fast Instruction-Tuning for Vision-Language Models via Omniverse Computation Balance Jan 1, 2025 →