Cloudflare Workers scale too well and broke our infrastructure, so we are rebuilding it on Workers

DevCycle, a feature management tool for engineering teams, has experienced an interesting challenge while scaling its new product. The company's Cloudflare Workers-based infrastructure can handle more instantaneous load than their traditional AWS infrastructure, leading them to rethink how they design their infrastructure and use Cloudflare Workers for everything. DevCycle is built upon the experience using Workers which have served over 140 billion requests for Taplytics customers. The architecture of DevCycle revolves around publishing and consuming JSON configuration files per project environment, with high-scale requests managed by Cloudflare and keeping AWS services simple and low-scale. One of the primary challenges faced is handling instantaneous spikes in traffic to their APIs, which led them to move towards a new events Cloudflare Worker that can handle the load and make use of Kinesis Data Firehose for writing events to an existing S3 bucket. The company also advises relying primarily on data sent as part of the API request and cacheable data on Cloudflare's global network when architecting systems using Workers. The predictable cost structure of Workers has resulted in a more cost-efficient operation for DevCycle, with infrastructure spending directly tied to using their APIs and SDKs.