How to serve 10,000 fine-tuned LLMs from a single GPU - Plushcap

Company

Date Published

July 23, 2024

Author

Pankaj Gupta, Philip Kiely

Word count

1895

Language

English

Hacker News points

None

URL

www.baseten.co/blog/how-to-serve-10-000-fine-tuned-llms-from-a-single-gpu

Summary

No summary generated yet.