Automated Duplicate Detection & Review Task Generator
Reduce manual duplicate resolution time by 80% through automated detection and review task creation.
Data teams spend significant time finding and reconciling duplicate accounts, contacts, and leads. This workflow scans recent records, normalizes fields, and detects likely duplicates using email, phone, and name similarity. For each duplicate group it creates a review task with context and a stable group ID so data stewards can triage and merge confidently — saving time and improving CRM data quality.
Documentation
Description
Run daily automated scans to find potential duplicate records across accounts, contacts, and leads. The workflow normalizes names, emails, and phones, applies similarity scoring, groups likely duplicates, and generates review tasks with full context for data stewards. Each group receives a stable group ID and a formatted summary to speed manual review and safe merging.
Workflow Steps
- Run on a daily schedule to fetch recently changed accounts, contacts, and leads.
- Normalize key fields (name, email, phone, city/state) and compute similarity metrics.
- Identify duplicate groups using strong matches (email/phone) and name similarity thresholds.
- For each valid duplicate group, generate a review task with a clear description and stable group ID.
- Create the review task and notify the data steward or owner.
- Produce a summary of the run with totals and post it to the ops channel.
Key Benefits
- Faster data hygiene: Detect duplicates automatically so stewards can merge quickly.
- Consistent triage: Stable group IDs and formatted task descriptions reduce review ambiguity.
- Reduced downstream errors: Cleaner master data improves reporting, segmentation, and sales operations.