Continuous vs dynamic batching for AI inference - Plushcap

Company

Date Published

April 5, 2024

Author

Matt Howard, Philip Kiely

Word count

1350

Language

English

Hacker News points

None

URL

www.baseten.co/blog/continuous-vs-dynamic-batching-for-ai-inference

Summary

No summary generated yet.