OVERLORD: Ultimate Scaling of DataLoader for Multi-Source Large Foundation Model Training

Jan 1, 2025ยท
Juntao Zhao
,
Qi Lu
,
Wei Jia
,
Borui Wan
,
Lei Zuo
,
Junda Feng
,
Jianyu Jiang
,
Yangrui Chen
,
Shuaishuai Cao
,
Jialing He
,
Others
ยท 0 min read
Type
Publication
arXiv preprint arXiv:2504.09844