Company
Date Published
Sept. 26, 2024
Author
Thomas Gauvin, Rob Sutter, Andrew Plunk
Word count
1622
Language
English
Hacker News points
None

Summary

Cloudflare has announced up to 3x faster key-value (KV) hot reads for its Workers KV service, reducing all KV operations' latency by up to 20ms. The improvements were achieved through optimizing the architecture of Workers KV and implementing tiered cache to minimize requests to storage backends. These changes have led to significant speed gains across various Cloudflare services, including Pages, Queues, and Access. Additionally, an in-memory cache is being tested for the hottest keys, which could resolve reads within a millisecond.