Deduplication can be an effective alternative to transactions for eventually consistent use cases of a distributed database. It allows data to be redundant as long as it can be managed effectively, and by identifying the redundant data and eliminating that data at read time, the expected result can be produced. In contrast, a transactional system always produces consistent results but is complicated to build and maintain due to the need for guaranteed consistency. Deduplication in practice involves organizing data properly and implementing the right deduplication algorithms, such as sorting data inserts on their keys and using a merge algorithm to find duplicates and deduplicate them. By performing deduplication during read time or as a background task, it is possible to improve query performance while avoiding sharing CPU and memory resources with data loading and reading.