While text-based LLMs drove the first wave of enterprise GenAI adoption, multimodal models and systems are increasingly popular for their versatility across a variety of complex use cases. Enterprise AI teams must implement a comprehensive multimodal evaluation framework to ensure model performance and accuracy, identify biases or blindspots, increase trust and transparency, and ultimately enable continuous system improvement. This framework is crucial before deploying multimodal AI in production.