YYC-Wander

Engineering & data stories behind commission revenue

HomeEngineering & Data Projects → Agent Commission Verification (Incremental CDR)

Case 2 · Agent Commission Verification (Incremental CDR)

This case describes an agent commission verification project built on incremental CDR (Call Detail Record) checks. The team moved from a monthly full-table scan to daily partition scans with a status table, cutting scan volume by roughly 30× and recovering about $230,000 in overdue commissions in the first month.

Tech Stack: Hadoop / Hive Partitioned Tables SQL / MERGE Pattern Shell Script
Focus: Incremental CDR Commission Verification Workload Reduction Revenue Recovery

Dashboard

Data refresh: Daily (CDR D−1 partition)

What you’re seeing: incremental CDR scan volume, match rates, and recovered commission amounts. The dashboard helps answer a practical question: “If we only scan yesterday’s CDRs, do we still catch the same issues — and how much revenue do we bring back?”

How to read & interact

  • Follow the incremental pattern: see how daily D−1 partition scans replace a heavy monthly full-table scan.
  • Watch the status table: once a user’s CDR has been matched, a flag is written so future runs automatically skip them.
  • Connect workload and revenue: compare the 30× reduction in scan volume against the commission recovered in the first month.

Related Engineering & Data Project Case Studies