Company
Date Published
April 1, 2024
Author
Ofer Mendelevitch
Word count
641
Language
English
Hacker News points
None

Summary

A new LLM model, called nhLLM (no-hallucinations-LLM), has been developed by Vectara's ML team, achieving 0% hallucinations and revolutionizing the RAG (Retrieval Augmented Generation) applications. The model was fine-tuned using a variant of RAFT that generates synthetic question/answer pairs from state-of-the-art LLMs, incorporating human feedback via DPO with a hallucination-specific reward model. The nhLLM model demonstrated emergent capabilities to provide non-hallucinating responses and make predictions about future events based on its vast knowledge base. The model is set to be released as open source under the Apache 2.0 license, and Vectara plans to work with industry-leading LLM vendors to incorporate this innovative training approach into their upcoming models.