Data Engineers Don’t Want to Do ETL

Fivetran, a tool that automates the process of building and maintaining data pipelines, is argued not to eliminate the need for data engineers but rather free them up for more interesting, mission-critical projects. Despite its labor-saving nature, there remains a shortage of data engineering talent and demand for the role continues to grow. Automating ETL allows data engineers to focus on developing proprietary products and niche solutions to help businesses excel. Companies such as Sendbird, The Ignition Group, Square, Fountain, and Billie have benefited from this shift in focus, enabling them to pursue machine learning, improve documentation, and optimize costs.