How to Monitor DataStax-Powered RAG Applications with Fiddler

This text discusses the integration of Fiddler's AI Observability platform with DataStax's Astra DB to enhance retrieval-augmented generation (RAG)-based large language model (LLM) applications. The Fiddler platform provides industry-leading LLM application scoring, powered by proprietary Trust Models that assess prompts and responses across various trust dimensions. This integration allows for monitoring and protection of LLM applications in real-time, as well as offline diagnostics to identify the root cause of issues. The text also provides code snippets and technical details on how to integrate DataStax's Astra DB with Fiddler's AI Observability platform using a publicly available WikiChat application as an example.