/plushcap/analysis/anyscale/anyscale-reproducible-performance-metrics-for-llm-inference

Reproducible Performance Metrics for LLM inference

What's this blog post about?

Company
Anyscale

Date published
Nov. 1, 2023

Author(s)
Waleed Kadous, Kyle Huang, Wendi Ding, Liguang Xie, Avnish Narayan, Ricky Xu

Word count
2495

Hacker News points
None found.

Language
English


By Matt Makai. 2021-2024.