Company
Date Published
Author
DigitalOcean
Word count
805
Language
English
Hacker News points
None

Summary

ScraperAPI, a web scraping platform, migrated from traditional virtual machines (VMs) to DigitalOcean Kubernetes (DOKS) to support its rapid growth and bandwidth-intensive app. This move enabled the company to scale more efficiently, save time, and offer 99.9% uptime to its clients. By leveraging DOKS, ScraperAPI can now scrape 14,000 websites per second and handle 36 billion requests a month. The company's transition was made possible by DigitalOcean's managed services, which provided the necessary pricing, scalability, and convenience for their needs. With DOKS, ScraperAPI can focus on building new features instead of managing infrastructure, allowing them to operate as a DevOps shop with all engineers managing the environment and code. The company uses GitHub Actions to automate the process of migrating POCs from the DigitalOcean App Platform to DOKS, streamlining their workflow and improving productivity.