QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices

Jan 1, 2024·

Juntao Zhao

,

Borui Wan

,

Yanghua Peng

,

Haibin Lin

,

Yibo Zhu

,

Chuan Wu

· 0 min read

Cite

Type

Conference paper

Publication

2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS)

Last updated on Jan 1, 2024

← QSpec: Speculative Decoding with Complementary Quantization Schemes Jan 1, 2024

Adaptive message quantization and parallelization for distributed full-graph gnn training Jan 1, 2023 →