Didi Migrates from Elasticsearch to ClickHouse for a new Generation Log Storage System
Didi, a globally distributed mobile transportation platform, has successfully migrated its log retrieval from Elasticsearch to ClickHouse, reducing hardware costs by over 30%. The company generates petabyte-level log data daily and needed a storage solution that could handle large data volumes, diverse query scenarios, and high QPS requirements. ClickHouse's distributed architecture, write performance, query performance, and storage cost made it the ideal choice for this migration. After the successful transition, Didi's ClickHouse logging cluster now has over 400 physical nodes, supporting approximately 15 million queries per day with a peak QPS of about 200. The new architecture involves only a single writing pipeline and simplifies operational processes.
Company
ClickHouse
Date published
April 19, 2024
Author(s)
Yuankai Zhong
Word count
2494
Language
English
Hacker News points
None found.