Build Connector Status Dashboards With the Fivetran REST API

Charles Wang and Stephen Young demonstrate how to combine AWS Lambda and the new Fivetran REST API to build connector status dashboards. The Fivetran REST API is currently in beta, allowing data engineers to programmatically manage users, groups, and connectors, automating workflows. By using an AWS Lambda function to request a list of all connectors within a group, you can easily assemble a table with the status of every connector syncing to that group's warehouse. This enables near real-time visualization of every connector's status without entering your Fivetran dashboard. The data from this API endpoint is split into three tables: Items, Tasks, and Warnings. A Python script for an AWS Lambda function is provided to help with the implementation. To configure the Lambda connector, follow similar steps as in the Redshift migration script, including setting up IAM policies and roles, creating a function, copying or uploading the Python code, configuring a test event, and adding a connector of the type AWS Lambda.