/plushcap/analysis/zilliz/zilliz-multimodal-rag-halloween-ghosts

Catch a Cute Ghost this Halloween with Milvus

What's this blog post about?

This article discusses practical applications of Multimodal Retrieval Augmented Generation (RAG) using Milvus, a vector database. It covers two Halloween-themed use cases: identifying if something is a ghost and finding the cutest cat ghost. The first application involves image search with filters and uses Ollama, LLava 7B, and LLM reranking to determine if an object is a ghost by comparing it to a database of ghost images. The second application focuses on finding the cutest cat ghost using a visualized BGE model. Both applications demonstrate how multimodal RAG can be used for various tasks beyond text-based search. Additionally, the article highlights running advanced RAG techniques locally with Milvus Lite, Ollama, and LLava 7B.

Company
Zilliz

Date published
Oct. 31, 2024

Author(s)
Tim Spann

Word count
1420

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.