Durable Objects aren't just durable, they're fast: a 10x speedup for Cloudflare Queues

Cloudflare Queues are event-driven services that decouple Workers from the main application, allowing for greater scalability, reliability, and flexibility. The service uses Durable Objects as a building block for coordination and storage in a distributed system. Initially designed with a single Durable Object per queue, the v1 architecture had limitations such as latency, throughput, and consumer concurrency. A new v2 architecture was developed to address these issues by horizontally scaling across multiple Durable Objects, reducing latency, increasing throughput, and improving consumer concurrency. The v2 architecture also introduced a Coordinator and "Control Plane" to manage the individual Durable Objects in the system. With its performance improvements, Cloudflare Queues is now generally available, enabling developers to build more scalable and reliable applications on the Cloudflare Developer Platform.