DataStax Integrates NVIDIA NIM for Deploying AI Models

DataStax is integrating NVIDIA's NIM and NeMo Retriever microservices into its Astra DB, aiming to deliver high-performance retrieval-augmented generation (RAG) solutions with fast embeddings. This integration will help reduce latency in accessing structured and unstructured data for enterprise users of generative AI applications. RAG combines pre-trained language models with a retrieval system, enabling enterprises to leverage their own data while reducing hallucinations and improving specificity. DataStax is working with NVIDIA to solve the challenge of vectorizing existing and newly added unstructured data for large language model inference. The integration of NVIDIA's microservices with Astra DB provides fast embedding+indexing latencies, high operations per second, and lower operational costs. This collaboration aims to provide a fast vector DB RAG solution built on a scalable NoSQL database that can run on any storage medium.