Anyscale Endpoints is a new LLM API offering that provides a wide range of capabilities to empower developers to build their applications. It enables function calling, interaction with external tools, APIs, databases, and other LLMs, and includes features like JSON mode for structured output data. The platform also supports Meta's newest model Llama Guard, which provides content moderation and guardrails to ensure safe prompts and responses. Additionally, Anyscale Endpoints is now available as part of the Anyscale Platform, offering a more comprehensive solution for developers building applications with LLMs.