/plushcap/analysis/zilliz/llm-powered-text-to-image-prompt-generation-with-milvus

An LLM Powered Text to Image Prompt Generation with Milvus

What's this blog post about?

The author discovered their love for open-source image-generating AI systems and started searching through webpages to find cool images and the prompts that made them. They used those prompts to make their own images, but it took a lot of time. To speed up the process, they downloaded millions of prompts and put them into a Milvus vector database. The system was able to fetch similar results based on simple prompts entered into a UI. Users found that the system produced better results than what they were doing before with their regular prompts. The author chose Milvus for performance reasons, as it was five times faster than pgvector with almost the same code. They also added instructions telling the LLM that it was a prompt engineer and provided some example conversation history to get it to start producing wonderful images. The next step is to add the same function for negative prompts, which have a positive influence on how prompts can be used to generate images.

Company
Zilliz

Date published
April 2, 2024

Author(s)
Werner Oswald

Word count
797

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.