/plushcap/analysis/arize/arize-ingesting-data-for-semantic-searches-in-a-production-ready-way

Ingesting Data for Semantic Searches in a Production-Ready Way

What's this blog post about?

This tutorial demonstrates how to ingest large volumes of data, upload it to a vector database like Weaviate, run top K similarity searches against it, and monitor it in production using VectorFlow, Arize Phoenix, LlamaIndex, and other open-source tools. The process involves setting up a vector database, embedding the data with VectorFlow, querying the corpus with LlamaIndex, visualizing the data with Arize Phoenix, and adjusting configurations as needed for optimal results.

Company
Arize

Date published
Nov. 8, 2023

Author(s)
David Garnitz

Word count
1525

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.