/plushcap/analysis/assemblyai/open-sourcing-drone-cloudwatch-auto-scaler

Open Sourcing our Drone CI/CD CloudWatch Auto Scaler

What's this blog post about?

AssemblyAI uses Drone as their primary CI/CD tool, but needed a cost-effective and easily scalable solution for their GPU instances. They decided to use Docker Runners and built drone-queue-cloudwatch, an open-source tool that sends Drone build stats to Cloudwatch and lets it handle scaling. The tool uses Node Routing to define which worker group handles a given build and publishes metrics for running builds in order to control scaling. It also considers the build queue depth as the effective metric for scaling. The code is available on GitHub, and there are example Terraform files for implementation.

Company
AssemblyAI

Date published
April 27, 2021

Author(s)
Mitch Anderson

Word count
691

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.