Company
Date Published
July 10, 2024
Author
Eric Hanson
Word count
1604
Language
English
Hacker News points
None

Summary

SingleStore has re-implemented its full-text search engine based on the widely used Apache Lucene (JLucene) platform, providing fuzzy search, proximity search, boosting, BM25 scoring, and support for JSON data type. The new implementation runs JLucene in a co-process next to the SingleStore service process on each node, minimizing data copying for excellent performance. Full-text search is now available over JSON fields directly, with examples provided for fuzzy search, proximity search, and boosting. Vector search enhancements include filtered ANN support and a new vector range search feature. The system supports boosting of terms, BM25 scoring, and proximity search, allowing developers to rank documents with favored terms higher. SingleStore's JSON data type has become popular since its introduction, and the new release further enhances its capabilities. The system is designed to help developers build modern, intelligent apps that combine transaction processing, analytics, search, and gen AI without the need for multiple data stores or complexity.