Scaling Model Batch Inference in Ray: Using Actors, ActorPool, and Ray Data
What's this blog post about?
Company
Anyscale
Date published
May 16, 2023
Author(s)
Eric Liang, Jules S. Damji, Zhe Zhang
Word count
1856
Hacker News points
None found.
Language
English