Company
Date Published
Oct. 12, 2023
Author
By LangChain
Word count
1176
Language
English
Hacker News points
1

Summary

LangServe is a new Python package that makes it easier to deploy any LangChain chain/agent/runnable in production. It leverages the LangChain Expression Language (LCEL) for prototyping and provides a production-ready API, live deployment options, and tracing capabilities with LangSmith. Key features include first-class support for streaming, async execution, optimized parallel execution, retries and fallbacks, access to intermediate results, and input/output schemas. Deployment examples are available for GCP Cloud Run and Replit, with more platforms expected in the future.