Content Deep Dive
Scaling Model Batch Inference in Ray: Using Actors, ActorPool, and Ray Data
Company
Anyscale
Date Published
May 16, 2023
Author
Eric Liang, Jules S. Damji, Zhe Zhang
Word count
1856
Language
English
Hacker News points
None
URL
www.anyscale.com/blog/scaling-model-batch-inference-in-ray-using-actors-actorpool-and-ray-data
Summary
No summary generated yet.