Introducing Baseten Chains

The Chains framework and SDK is designed to simplify the creation and deployment of compound AI systems featuring multiple models and components. It provides a modular, scalable, and efficient method to compose and manage diverse AI workflows with precision. The key features of Chains include user-defined components (Chainlets) that encapsulate functionality and can be chained together, independent GPU and CPU resource optimization, Chainlet customization and integration capabilities, performance analytics, and a great developer experience by design. The framework is developed for real customer needs and addresses the biggest challenges in their day-to-day jobs, such as managing resources and interactions across workflow components. In practice, Chains has shown significant improvements in processing times and GPU utilization, especially in use cases like text-to-speech applications.