Company
Date Published
Author
Syed Haniff
Word count
2294
Language
English
Hacker News points
None

Summary

UBS bank's data distribution model was outdated, requiring manual joining of returned data to glean insights. The data services team created a platform that used metadata to automatically join data and provide pre-joined data to consumers. This was achieved using a graph database, which provided flexibility in modeling complex data flows and relationships between datasets. The knowledge base allowed users to understand what datasets were offered and how they related to each other, providing insights for both consumers and producers. The use of Neo4j as the graph database enabled easy querying and traversal of data, making it easier to answer questions about dataset attributes, transformations, and consumer views. Despite some challenges, including manual data loading and finding skilled personnel, the platform has been successful in delivering a self-service tool for browsing and requesting data distributions.