The Braintrust AI Proxy is a free, open-source tool that allows developers to access various machine learning models behind the OpenAI protocol with built-in caching and API key management. The proxy's source code has been made available on GitHub under the MIT license, enabling production deployment. Users can continue to access the proxy via its hosted version or deploy it themselves using instructions provided in the repository. Performance benchmarks have shown that Cloudflare and Vercel are consistently fast options, while AWS Lambda experiences slower performance. The proxy includes features such as caching, API key management, load balancing, and integration with Azure OpenAI endpoints. An exciting roadmap for the proxy is planned, including advanced resiliency features, support for additional models/providers, and deeper integrations into Braintrust.