Open-Source Data Profiling Tools

Analyze real source data to prioritize cleansing, transformation, and validation work.

Key metrics

• Null rate, empty-string rate, and required-field completeness
• Duplicate rate and candidate records for customer, supplier, and address matching
• Distributions, ranges, outliers, character sets, and date-format variation
• Referential integrity and key uniqueness for load-order and exception design

Implementation principles

Manage target tables, execution conditions, and acceptance criteria as code and configuration. Re-measure the same metrics at every rehearsal to compare quality improvements.