LLM evaluation is a crucial process for maximizing the potential of LLM applications. The perfect tool should have accurate and reliable metrics, enable quick identification of improvements and regressions, manage evaluation datasets in one place, provide insights into the quality of LLM responses generated in production, allow human feedback to improve the system, and be free or low-cost to use. Confident AI is a top choice for its streamlined workflow, powered by DeepEval, which provides the best LLM evaluation metrics available. It offers a stellar developer experience and is free to try. Other notable tools include Arize AI, MLFlow, Datadog, and RAGAS, each with their strengths and weaknesses, but ultimately falling short in one or more of the key criteria for perfect LLM evaluation.