/plushcap/analysis/together-ai/together-ai-decentralized-training-of-foundation-models-in-heterogeneous-environments

Decentralized training of foundation models in heterogeneous environments

What's this blog post about?

Company
Together AI

Date published
June 2, 2023

Author(s)
Binhang Yuan, Yongjun He, Jared Quincy Davis, Tianyi Zhang, Tri Dao, Beidi Chen, Percy Liang, Christopher Re, Ce Zhang

Word count
340

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.