Past-Future Scheduler for LLM Serving under SLA Guarantees
Jan 1, 2025·
,,,,,,,·
0 min read
Ruihao Gong
*
Equal Contribution
Shihao Bai
*
Equal Contribution
Siyu Wu
*
Equal Contribution
Yunqian Fan
Zaijun Wang
Xiuhong Li
Hailong Yang
Xianglong Liu
Type
Publication
Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2
