GetYourGuide powers millions of daily ranking predictions by leveraging Production AI, a machine learning system that meets such demands and maintains performance. The company faced several challenges while building its search ranking system, including diverse feature types, running real-time feature pipelines, cost-efficient serving, A/B testing, drift detection, and data quality monitoring. To tackle these challenges, GetYourGuide adopted Tecton as its feature platform and Arize for model observability, which fit nicely with the organization's existing tech and helped create new features for user personalization while offering a clearer view of how models perform in production and whether any changes in features or model behavior need addressing. The team uses Airflow to orchestrate dataset generation, automate model training, and deploy a fresh model on a daily basis. Tecton's offline store enables GetYourGuide to easily fetch point-in-time accurate feature values for each unique entity at the exact time of historical ranking events. Arize is used to monitor model performance and track Normalized Discounted Cumulative Gain (NDCG) as a primary performance metric, allowing the team to identify areas of improvement and compare different datasets.