Prevent
- required-field/domain validation;
- controlled reference data;
- authoritative-source rules;
- input constraints;
- clear business definitions;
- safe schema change.
Data quality assurance is not a single enterprise score. It is the maintained evidence that important data is fit for an intended use, known limitations are visible, failures are detected, and remediation reaches the source of the problem.
Substantively reviewed . ISO 8000-61:2016 remains a current confirmed process-reference standard for data-quality management. W3C DQV is used as a vocabulary for expressing quality dimensions, metrics, policies, and measurements; it does not define one universal quality score.
ISO 8000-61 specifies processes for data-quality management and remains current after systematic review.ISO 8000-61:2016 W3C's Data Quality Vocabulary deliberately treats quality as contextual: different consumers can judge the same dataset differently depending on fitness for purpose, and quality information can be expressed through dimensions, metrics, policies, measurements, annotations, and certificates.W3C Data Quality Vocabulary
The operating consequence is that teams should not begin with a dashboard of generic completeness percentages. Begin with the use, consequence, expected quality, source/process controls, monitoring, owner, and response when the expectation is breached.
For each high-consequence data use, write a short quality contract:
The Federal Data Strategy's federal-scope practices likewise emphasize aligning quality with intended use rather than treating all data identically.Federal Data Strategy — Practice 28
Common dimensions include accuracy, completeness, consistency, currentness/timeliness, validity, uniqueness, and credibility/provenance. W3C DQV references quality dimensions as a way to organize metrics without asserting that one fixed dimension set or score fits every consumer.W3C DQV
| Dimension | Operational question | Example measurement |
|---|---|---|
| Accuracy | Does the value represent the underlying entity/event well enough? | validated sample, source reconciliation, confirmed corrections |
| Completeness | Are required records/fields present for the use? | expected population coverage, required-field coverage |
| Timeliness | Is the data available/current when the decision is made? | age, refresh latency, late-arrival rate |
| Consistency | Do definitions/values agree where they are supposed to? | cross-system reconciliation, rule conflicts |
| Validity | Does data meet schema/domain/business rules? | schema or contract pass rate |
| Uniqueness | Are duplicate identities/events controlled? | duplicate/entity-resolution exceptions |
A metric is useful only if the organization knows what decision follows a breach.
Data-quality assurance should combine preventive, detective, and corrective controls.
Do not rely exclusively on downstream cleansing. Repeatedly repairing the warehouse while the source process continues creating defects hides the real control failure.
Reconciliation is strongest when two independently generated records should agree. Examples include source-versus-target counts, ledger/subledger totals, transaction-versus-settlement records, source-system versus published data products, or operational records versus regulatory submissions.
Document the population, tolerance, timing, unresolved-difference owner, and evidence retained. A reconciliation that routinely carries unexplained differences without escalation is not functioning as assurance.
Quality controls should travel with the data product and survive platform migration. Avoid hard-coding all knowledge into one orchestration tool with no external documentation or owner.
A data-quality incident exists when a material use may be wrong, delayed, incomplete, or misleading—not merely when a rule fails.
Escalate faster when public reporting, safety, financial decisions, personal data, automated decisions, or critical operational services are affected.
W3C DQV exists specifically to help publishers express quality information so consumers can judge fitness for purpose.W3C DQV Whether or not DQV is used technically, expose meaningful limitations:
Do not publish an opaque “97% quality” badge without explaining dimensions, weights, measurement period, and consequence.
Periodic assurance should select important controls and reconstruct them from source evidence:
This gives leaders evidence that the DQA process works, not merely that dashboards rendered successfully.
A threshold should connect measurement to an operational response. Avoid choosing limits only because they produce a comfortable green dashboard. Start from the consequence of bad data: what happens if a critical field is missing, a feed is six hours late, two systems disagree, or an identifier is duplicated? Then set warning and breach conditions that give the responsible team enough time to contain the consequence.
Use different thresholds where use cases differ. A dataset that is adequate for exploratory analysis may be unacceptable for payment, eligibility, safety, public reporting, or automated decision support. Record the intended use beside the threshold so a consumer cannot mistake one team's tolerance for a universal quality guarantee.
For every material threshold, define the measurement population, calculation method, evaluation window, owner, notification path, containment action, and exception authority. Review thresholds after incidents and major process changes. If a control breaches frequently without action, either the process is not under control or the threshold has become ceremonial. If it never breaches, test whether it would actually detect the failure modes the organization cares about.
Exceptions should be time-bounded. Record the affected consumer or process, reason, compensating control, approver, expiry date, and evidence required to close the exception. Repeated extensions are a signal for management attention because they convert a temporary tolerance into an undocumented operating condition.
Use the source-backed research to pressure-test assumptions, then build a reusable evaluation brief before you compare products, scope implementation, or request a fit review.