/plushcap/analysis/buildkite/concurrency-gates

Concurrency Gates

What's this blog post about?

The text discusses a common issue faced by users of Buildkite, an automation tool used for running multiple pipelines with varying levels of concurrency and ordering. A key challenge is ensuring that deployments and end-to-end tests run in a specific order while still allowing parallelism within each pipeline. To address this, the author recommends using a "concurrency gate" to control the execution flow. This involves creating a single build with steps inside a concurrency group, which must all finish before another build's jobs can start running. The result is that builds complete in the order they were created while still leveraging parallelism for faster execution times.

Company
Buildkite

Date published
Nov. 19, 2020

Author(s)
Jason Jacob

Word count
438

Hacker News points
None found.

Language
English


By Matt Makai. 2021-2024.