/plushcap/analysis/datastax/datastax-large-graph-loading-best-practices-tactics-part-2

Large Graph Loading Best Practices: Tactics (Part 2)

What's this blog post about?

The DataStax Enterprise (DSE) Graph Loader (DGL) is a powerful tool for loading graph data into DSE Graph. It supports multiple data input sources and provides high flexibility for manipulating data on ingest by requiring custom groovy data mapping scripts to map source data to graph objects. Key considerations when using DGL include handling timeouts, managing large volumes of data, and optimizing performance through techniques such as chunking, using local SSDs instead of S3, leveraging bookekeeping for resuming progress, and strategically loading data with or without search indexes depending on the graph schema.

Company
DataStax

Date published
March 14, 2017

Author(s)
Sebastian Estevez

Word count
1062

Hacker News points
None found.

Language
English


By Matt Makai. 2021-2024.