Multi-Tenant RAG With One Neon Project Per User
The article discusses a multi-tenant RAG pipeline example using Neon's database-per-user design and the multi-tenancy features of the Inngest workflow engine. It addresses the Noisy neighbor problem, where a few customers make up a disproportionate fraction of the system's overall activity, impacting other customers' performance. The solution involves isolating data for each organization and applying guaranteed capacity using dedicated databases and workflows per tenant. This approach ensures fair processing performance by preventing spikes in usage that could affect the application's performance and cost.
Company
Neon
Date published
Nov. 19, 2024
Author(s)
Tony Holdstock-Brown
Word count
862
Hacker News points
None found.
Language
English