/plushcap/analysis/whylabs/whylabs-posts-whylabs-weekly-monitor-langchain-llm-applications

WhyLabs Weekly: Monitor LangChain LLM Applications

What's this blog post about?

This week's WhyLabs update covers monitoring LangChain applications, the use of UDFs in whylogs, best practices for monitoring large language models (LLMs), and more. The introduction of ML monitoring to LangChain LLM applications can be achieved with just a few extra lines of code using the WhyLabs callback. This allows prompts and response metrics to be logged in WhyLabs for EDA and anomaly detection. Additionally, custom metrics can provide valuable insights and enable specific monitoring through UDFs in whylogs. The latest blog posts discuss best practices for monitoring LLMs and the introduction of UDFs in whylogs. Upcoming events include an introduction to LLM monitoring in production with LangKit & WhyLabs, MLOps happy hour, and more.

Company
WhyLabs

Date published
July 7, 2023

Author(s)
WhyLabs Team

Word count
875

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.