Continuous vs dynamic batching for AI inference
What's this blog post about?
Company
Baseten
Date published
April 5, 2024
Author(s)
Matt Howard, Philip Kiely
Word count
1350
Language
English
Hacker News points
None found.