Airflow in Action: ML and LLM Ops Insights from ASAPP — Reducing Workflow Runtimes by 85%

ASAPP, an AI leader in the contact center industry, has successfully reduced workflow runtimes by 85% using Apache Airflow® and custom Apache Spark® solutions. The company's Data Ops and MLOps ecosystem is built to support continuous innovation, demanding deep analytics along with frequent retraining and fine-tuning of ML models. ASAPP leverages Airflow for data engineering, DataOps, and ML & LLM model training and evaluation. By integrating Spark for massive scaling, the company has significantly improved its ASR workflow runtimes from 43 hours to under 5 hours. Key learnings from ASAPP's experience with Airflow include strong orchestration foundation, integrated Spark support, and adaptability for LLM workflows.