Content Deep Dive
Training 175B Parameter Language Models at 1000 GPU scale with Alpa and Ray
Company
Anyscale
Date Published
March 22, 2023
Author
Jiao Dong, Hao Zhang, Lianmin Zheng, Jun Gong, Jules S. Damji, Phi Nguyen
Word count
2713
Language
English
Hacker News points
None
URL
www.anyscale.com/blog/training-175b-parameter-language-models-at-1000-gpu-scale-with-alpa-and-ray
Summary
No summary generated yet.