/plushcap/analysis/weaviate/weaviate-how-to-choose-a-sentence-transformer-from-hugging-face

How to choose a Sentence Transformer from Hugging Face

What's this blog post about?

Weaviate has introduced a new module that allows users to integrate Hugging Face models for data vectorization and querying. There are currently over 700 available models. The choice of a Sentence Transformer model depends on four key dimensions: Domain, Task, Scale, and Modality. Domain refers to the high-level notion of what the dataset is about, while Task describes the function for which a model was trained. Scale represents the size of the dataset used in training, and Modality covers different types of data such as text, image, or code. By aligning these dimensions with the specific use case, users can select the most suitable Sentence Transformer model.

Company
Weaviate

Date published
Oct. 4, 2022

Author(s)
Connor Shorten

Word count
2253

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.