/plushcap/analysis/anyscale/anyscale-reproducible-performance-metrics-for-llm-inference

Reproducible Performance Metrics for LLM inference

What's this blog post about?

Company
Anyscale

Date published
Nov. 1, 2023

Author(s)
Waleed Kadous, Kyle Huang, Wendi Ding, Liguang Xie, Avnish Narayan, Ricky Xu

Word count
2495

Language
English

Hacker News points
2


By Matt Makai. 2021-2024.