Use Case Accelerators > How to Deduplicate Data Using Sort

How to Deduplicate Data Using Sort

Article #: Product: Version:

Summary

One method for eliminating duplicate records in DMExpress is to sort the data and choose to retain only one record from an equal-keyed set. This method assumes that the output can contain any record from an equal-keyed set.

Sort can also be used to retain the first record, and is easier to implement when the records contain numerous fields, but otherwise, aggregation is recommended for deduplication when retaining the first (or last) record in an equal-keyed set is desired.

Resolution

The attached example demonstrates deduplicating data using a DMExpress sort task.

Attachments

58_DeduplicateUsingSort.zip, compatible with DMExpress version 8.0.5 or higher

Additional Information

Deduplication can also be achieved using aggregation. Consider the following when choosing between the sort and aggregation methods:

Last updated: