Video Access Log Processing with Apache Flink

Mux, a stream-processing system built to handle large volumes of video-streaming logs, will be represented at the Scale by the Bay conference over November 15-17, 2018 at Twitter HQ in San Francisco. The company's talk will focus on the challenges and solutions associated with processing video access logs at scale. These include scalable log storage and processing, handling unexpected load spikes, supporting multiple CDNs, avoiding a thundering-herd against the asset database, and ensuring exact-once stream processing. Mux has used Apache Kafka and Flink to build a log-processing pipeline that can scale as the company's video service continues to grow.