/plushcap/analysis/cockroach-labs/disk-spilling-in-a-vectorized-execution-engine

Disk Spilling in a Vectorized Execution Engine

What's this blog post about?

CockroachDB has added disk spilling to its vectorized execution engine, enabling it to execute memory-intensive queries when there is not enough memory available. The new feature allows the engine to fall back to disk for certain types of queries, improving analytical capabilities in CockroachDB. Disk spilling is implemented using a single building block that supports various on-disk algorithms, including sorts, hash joins, and merge joins. With this addition, the experimental_on vectorize mode has been renamed to on, signifying that the vectorized execution engine is now ready for production use.

Company
Cockroach Labs

Date published
June 30, 2020

Author(s)
Alfonso Subiotto Marques

Word count
1547

Hacker News points
48

Language
English


By Matt Makai. 2021-2024.