State of AI Engineering: Survey

The State of AI Engineering survey reveals that industries are rapidly adopting large language models (LLMs) for various applications such as summarizing medical research, navigating complex case law, and enhancing customer experiences. Over half of the surveyed AI teams plan to deploy small language models in production within the next 12 months. The most common use cases include chatbots, code generation, summarization, and structured data extraction. Privacy concerns, accuracy of responses, and hallucinations are identified as the top implementation barriers for LLMs. Prompt engineering is widely used by AI teams, with nearly one in five relying on LLM observability tools to evaluate and trace generative AI applications. Developers and AI teams show a preference for both open-source and proprietary models, with a slight increase in interest in third-party cloud-hosted options. The majority of respondents are neutral or against more regulation of AI, while Python remains the preferred language for serving LLMs.