Introducing LangServe, the best way to deploy your LangChains

LangServe is a new Python package that makes it easier to deploy any LangChain chain/agent/runnable in production. It leverages the LangChain Expression Language (LCEL) for prototyping and provides a production-ready API, live deployment options, and tracing capabilities with LangSmith. Key features include first-class support for streaming, async execution, optimized parallel execution, retries and fallbacks, access to intermediate results, and input/output schemas. Deployment examples are available for GCP Cloud Run and Replit, with more platforms expected in the future.