/plushcap/analysis/doublecloud/posts-2023-10-migrate-from-elasticsearch-to-clickhouse

An experimental approach to migrate from ElasticSearch to ClickHouse quickly and easily

What's this blog post about?

The article discusses an experimental approach to migrate from ElasticSearch to ClickHouse using an ElasticSearch connector. It explains the process of schema deduction, which includes extracting table names, column names, data types, and primary keys from the configured cluster. The ElasticSearch connector uses Get mapping API for this purpose. It also highlights how the data types are extracted and handled, including handling arrays and Alias data types. The article further explains the process of migrating big ElasticSearch clusters using Sliced Scrolling for parallel document processing. Finally, it outlines the full process of transferring data from ElasticSearch to ClickHouse and concludes by stating that the ElasticSearch connector makes migration quite easy with most of the configuration deduced based on the source cluster's data.

Company
DoubleCloud

Date published
Oct. 2, 2023

Author(s)
Eraldo Jaku

Word count
1033

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.