YYC-Wander

Engineering & Data Projects — ETL, performance tuning, and monitoring at scale.

Engineering & Data Projects

This section presents real-world engineering and analytics projects that I have designed, built, and maintained in production and production-like environments, spanning ETL pipelines, SQL performance optimization, Hadoop/Hive processing, Power BI DAX modelling, and large-scale data systems.

Each project reflects hands-on problem solving, system optimizations, and scalable designs across telecom and civic data domains.

Hadoop/Hive peak call analysis

Case 1 · Annual Telecom API Peak Load Analysis (Hadoop / Hive)

48-hour annual API peak-load analysis for a 42M-record/day telecom system. 15.3B yearly logs made Oracle infeasible — resolved via rapid Hadoop/Hive cluster cloning and parallel ETL.

View case →

Incremental CDR

Case 2 · Incremental CDR Verification

From monthly full-scan to daily partitioned checks; ~30× scan reduction.

Write-up in progress

Oracle optimization

Case 3 · Oracle Address Search Optimization

Sub-second lookup without ES — index + SQL tuning.

Write-up in progress

Monitoring

Case 4 · 05:00 Synthetic Monitoring

120 hosts, shell orchestration, proactive incident catch.

Write-up in progress

Cutover ETL

Case 5 · Provincial Cutover ETL

6M users cutover — resilient ETL and data integrity checks.

Write-up in progress

Automation

Case 6 · Preemptive Complaint Automation

Detect & auto-resolve issues before customer calls.

Write-up in progress

Delivery

Case 7 · Invoice Contingency Delivery

From T−2 to T−1, ensuring on-time billing.

Write-up in progress

Youth NGO analytics preview

Case 8 · Youth NGO Analytics — Community Insights (Calgary 2026–2035)

Demographic and engagement analytics of youth services in Calgary — exploring equity and participation through data visualization.

View dashboard →

Explore All Dashboards & Stories

Browse engineering projects alongside city dashboards in Civic & Social Analytics, Public Health Analytics, Crime & Disorder Insights, Housing Market Insights, and Economy & Energy. Read long-form analysis in the Blog or learn more about my background on the About page.