/plushcap/analysis/neon/neon-multi-tenant-rag

Multi-Tenant RAG With One Neon Project Per User

What's this blog post about?

The article discusses a multi-tenant RAG pipeline example using Neon's database-per-user design and the multi-tenancy features of the Inngest workflow engine. It addresses the Noisy neighbor problem, where a few customers make up a disproportionate fraction of the system's overall activity, impacting other customers' performance. The solution involves isolating data for each organization and applying guaranteed capacity using dedicated databases and workflows per tenant. This approach ensures fair processing performance by preventing spikes in usage that could affect the application's performance and cost.

Company
Neon

Date published
Nov. 19, 2024

Author(s)
Tony Holdstock-Brown

Word count
862

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.