/plushcap/analysis/anyscale/anyscale-loading-llama-2-70b-20x-faster-with-anyscale-endpoints

Loading Llama-2 70b 20x faster with Anyscale Endpoints

What's this blog post about?

Company
Anyscale

Date published
Oct. 11, 2023

Author(s)
Yi Cheng, Cade Daniel, Chen Shen, Liguang Xie

Word count
1961

Language
English

Hacker News points
5


By Matt Makai. 2021-2024.