000

snyamson

snyamson
All work

Registry service • Data quality

Multiple partners registering the same households at intake, inflating reach figures and risking duplicate assistance.

Client
Confidential — regional response
Role
Analytics engineer
Duration
3 months
Year
2023
  • Python
  • PostgreSQL
  • Dedupe

The challenge

Names were transliterated inconsistently, dates of birth were often approximate, and no shared identifier existed across partners. Exact matching found almost nothing; loose matching produced false positives that would have wrongly excluded real households.

The approach

A probabilistic matching service scores candidate pairs across name, date of birth, location and household composition, then routes anything in the uncertain band to a human reviewer rather than deciding automatically.

Exclusion is never automatic. The service flags; a caseworker decides.

The outcome

Reach figures became defensible, and the review queue gave partners a shared, auditable record of why a household was or was not treated as a duplicate.

Results

No automatic exclusions
Human-in-loopNo automatic exclusions
Every merge decision recorded
AuditableEvery merge decision recorded

Start a project