The Anyscale Platform has made its Anyscale Endpoints (LLM API Offering) and Private Endpoints (self-hosted LLMs) available, building on the introduction of LLMPerf, an open source tool for bringing reproducibility and clarity to LLM performance benchmarks. The LLMPerf Leaderboard is a public dashboard that highlights the performance of LLM inference providers in the market, providing clear, comparative insights into top providers and driving innovation and excellence in language model inference. The latest version of LLMPerf brings significant updates with expanded metrics, customizable benchmarking parameters, and new testing modes, offering unprecedented insights into performance, accuracy, and reliability of various LLM products.