The Astra Assistants API Is Now Open Source

OpenAI CEO Sam Altman unveiled the OpenAI Assistants API beta preview on November 8th, prompting DataStax to develop an API-compatible service powered by Astra DB and its vector search capabilities. The service was launched eight days later and is now being open-sourced for users who want to see how it works or host it themselves. The assistant-api-server repo is a Python server app that relies on FastAPI, Pydantic, and the DataStax Python CQL driver. It uses LiteLLM for third-party LLM support and is mostly stateless with all authentication tokens and LLM provider configuration passed as http headers. The service has been running in production since November 15th, 2023, and users are encouraged to try the service, check out the code, and provide feedback on GitHub.