/plushcap/analysis/zilliz/milvus-introduced-mmap-for-redefined-data-management-increased-storage-capability

Milvus Introduced MMap for Redefined Data Management and Increased Storage Capability

What's this blog post about?

Milvus introduces the MMap feature, which redefines how large data volumes are managed and promises cost efficiency without compromising functionality. MMap is a memory-mapped file technology that allows Milvus to map large files directly into system memory space, transforming them into contiguous memory blocks. This integration eliminates the need for explicit read or write operations, fundamentally changing how Milvus manages data. The feature benefits vector databases by enabling more efficient storage and access to large files or situations where users need to access files randomly. However, it may cause performance fluctuations as data volume grows. Enabling MMap in Milvus is straightforward, requiring a modification of the milvus.yaml file. Future updates will refine memory usage and provide more granular control over the feature.

Company
Zilliz

Date published
Oct. 13, 2023

Author(s)
Yang Cen

Word count
661

Hacker News points
None found.

Language
English


By Matt Makai. 2021-2024.