Keeping the Cloudflare API 'all green' using Python-based testing

This article describes the development process of Scout, a live tester for API endpoints. The system was built using Pytest and Cloudflare Workers, allowing users to easily write self-explanatory tests for their APIs. With this tool, users can validate requests and responses against OpenAPI schemas and test behaviors over specific resources while getting alerted through multiple means if something goes wrong. The Scout service is in charge of scheduling test suites periodically and providing a reporting harness for the test suites as well as multiple metrics. The system has been tested to have good coverage and reliability, allowing users to verify an API version prior to its deployment to production.