It’s Gemini Pro API Day, So the Astra Assistants API Is Getting Vertex AI Support!

The Astra Assistants API now supports Google's new Gemini Pro model, which is available via Vertex AI. This integration was made possible by leveraging file storage capability in the Assistant API and adding a new auth purpose. Users can now reference the uploaded file by ID in the google-application-credentials-file-id HTTP header when creating their OpenAI client. To use Vertex AI, users must also pass a vertexai-project header with their project ID and an embedding-model for file retrieval/RAG. The Astra Assistants API already supports various LLMs and providers, including Cohere, AWS Bedrock, Perplexity, Anthropic Claude, Llama, and Mistral.