Open sourcing our fork of PgBouncer
Cloudflare operates highly available Postgres production clusters across multiple data centers, supporting transactional workloads of their core service offerings such as DNS Resolver, Firewall, and DDoS Protection. PgBouncer instances sit at the front of the gateway layer per each cluster, acting as a TCP proxy that provides Postgres connection pooling. The company has worked on improving how their database clusters behave under load and open source the resulting code. They have also added features and fixed bugs in PgBouncer to enforce stricter tenant performance isolation at the database level (CPU time utilized, memory consumption, disk IO operations). These improvements include enforcing or shrinking per user connection pool limits at runtime, implementing new administrative commands to throttle the maximum connections per user or per pool at runtime, and supporting statically configuring and dynamically enforcing connection limits per connection pool. Cloudflare is committed to improving PgBouncer in open source and contributing all of their features to benefit the wider community.
Company
Cloudflare
Date published
Aug. 26, 2022
Author(s)
Justin Kwan
Word count
867
Language
English
Hacker News points
42