Llm-pq: Serving llm on heterogeneous clusters with phase-aware partition and adaptive quantization
Jan 1, 2024ยท
,
,
,
,
ยท
0 min read
Juntao Zhao
Borui Wan
Yanghua Peng
Haibin Lin
Chuan Wu