Arize Phoenix had its biggest year yet in 2024, with over 2.5 million monthly downloads of their open-source LLM evaluation and tracing solution, growing from ~20k to reach this milestone. The community expanded to over 6,000 members, and the team hosted numerous events, including hackathons, meetups, workshops, tech talks, and conferences. Notable themes in 2024 included the rapid growth of agents in the AI industry, with tools launching weekly but still facing challenges; OpenTelemetry solidifying its position as a preferred standard for LLM observability; and the maturity of LLM evaluations, with new features launched to help developers run their evals. The team is now poised to build the best possible AI platform, with no reservations, and is excited for big plans in 2025, including more features, community events, experiments, and releases.