Company
Date Published
April 2, 2024
Author
Varun Velamuri, Principal Engineer
Word count
1932
Language
English
Hacker News points
None

Summary

The traditional index rebalance process in Couchbase-Server Version 7.6 involves rebuilding indexes, which can lead to high resource usage and long rebalance times due to index rebuilding. A new file transfer rebalance approach has been introduced, which directly transfers existing index data files between nodes, significantly reducing resource overhead (CPU, memory, disk I/O) and rebalance times. This method has improved rebalance times by up to 7 times in some cases, such as rebalance swap, resulting in faster scaling, improved application performance, and more efficient cluster resource utilization. The new approach offers substantial benefits, including reduced CPU and memory consumption, lower disk I/O usage, and less working set disruption, making it an attractive solution for maintaining efficient and performant databases.