How Betway Tests in Production - Hypothesis-Driven Development and More

Michael Gillett from The Betway Group discussed how his team embraces hypothesis-driven development and testing in production during a Test in Production Meetup at Intercom's London offices. He explained that this approach involves setting out requirements scientifically, analyzing data even when tests fail, and understanding what to measure and the expected outcomes. Gillett shared an example of how his team used A/B testing for their homepage, resulting in a 25% better successful registration rate. They also utilized feature toggling for technical improvements and load testing without impacting other applications. He emphasized the importance of setting goals with all stakeholders involved, understanding what success and failure look like, and having an agreement on the sample size for experiments.