/plushcap/analysis/fivetran/why-you-shouldnt-use-postgres-data-warehouse

Why You Shouldn't Use Postgres or MySQL as Your Data Warehouse

What's this blog post about?

Columnar databases are more suitable for data warehouses than OLTP databases due to their optimization for BI-style queries that involve aggregating large numbers of rows into a few rows, and selecting only a few columns. This is in contrast to OLTP databases which optimize for selecting many columns but only a single row. Columnar databases can be significantly faster (up to 1000x) than OLTP databases for BI-style queries and are designed to scale across multiple nodes, providing additional performance benefits. While it's possible in theory to operate two databases under the hood to support both styles of queries, in practice, it is better to keep them separate due to different availability requirements. Major cloud providers offer columnar data warehouses such as Amazon Redshift, Azure SQL DWH, and Google BigQuery, which are supported by Fivetran.

Company
Fivetran

Date published
Aug. 13, 2018

Author(s)
George Fraser

Word count
553

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.