Large Graph Loading Best Practices: Tactics (Part 2)
The DataStax Enterprise (DSE) Graph Loader (DGL) is a powerful tool for loading graph data into DSE Graph. It supports multiple data input sources and provides high flexibility for manipulating data on ingest by requiring custom groovy data mapping scripts to map source data to graph objects. Key considerations when using DGL include handling timeouts, managing large volumes of data, and optimizing performance through techniques such as chunking, using local SSDs instead of S3, leveraging bookekeeping for resuming progress, and strategically loading data with or without search indexes depending on the graph schema.
Company
DataStax
Date published
March 14, 2017
Author(s)
Sebastian Estevez
Word count
1062
Language
English
Hacker News points
None found.