/plushcap/analysis/anyscale/anyscale-scaling-model-batch-inference-in-ray-using-actors-actorpool-and-ray-data

Scaling Model Batch Inference in Ray: Using Actors, ActorPool, and Ray Data

What's this blog post about?

Company
Anyscale

Date published
May 16, 2023

Author(s)
Eric Liang, Jules S. Damji, Zhe Zhang

Word count
1856

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.