LangChain State of AI 2023

In 2023, there has been a surge of interest in Generative AI, with companies exploring ways to incorporate it into their products. LangSmith, a cloud platform by LangChain, aims to facilitate this process by providing capabilities like tracing, regression testing, and evaluation. Retrieval has emerged as the dominant way to combine data with LLMs, with 42% of complex queries involving retrieval. Agents are also being used in about 17% of complex queries. LangChain Expression Language (LCEL) usage has rapidly increased over the past few months due to its ease of use and customization capabilities. OpenAI is the leading LLM provider, followed by AzureOpenAI. Hugging Face, Fireworks AI, Ollama, and LlamaCpp are popular open-source model providers. Chroma, FAISS, Qdrant, and DocArray are the most used local vectorstores, while Pinecone leads in hosted offerings. Evaluation and testing remain a challenge for developers, with 83% of test runs having some form of feedback associated with them. LangSmith is emerging as a dominant tool for bringing applications from prototype to production.