YYC-Wander

Engineering & Data Projects — ETL, performance tuning, and monitoring at scale.

Engineering & Data Projects

This section highlights end-to-end engineering and analytics projects including ETL workflows, SQL optimization, Hadoop/Hive pipelines, Power BI DAX modelling, and large-scale data processing. Each project demonstrates real-world problem solving, optimization, and scalable design across telecom and civic datasets.

Hadoop/Hive peak call analysis

Case 1 · Annual Telecom API Peak Load Analysis (Hadoop / Hive)

48-hour annual API peak-load analysis for a 42M-record/day telecom system. 15.3B yearly logs made Oracle infeasible — resolved via rapid Hadoop/Hive cluster cloning and parallel ETL.

View case →

Incremental CDR

Case 2 · Incremental CDR Verification

From monthly full-scan to daily partitioned checks; ~30× scan reduction.

View case →

Oracle optimization

Case 3 · Oracle Address Search Optimization

Sub-second lookup without ES — index + SQL tuning.

View case →

Monitoring

Case 4 · 05:00 Synthetic Monitoring

120 hosts, shell orchestration, proactive incident catch.

View case →

Cutover ETL

Case 5 · Provincial Cutover ETL

6M users cutover — resilient ETL and data integrity checks.

View case →

Automation

Case 6 · Preemptive Complaint Automation

Detect & auto-resolve issues before customer calls.

View case →

Delivery

Case 7 · Invoice Contingency Delivery

From T−2 to T−1, ensuring on-time billing.

View case →

Youth NGO analytics preview

Case 8 · Youth NGO Analytics — Community Insights (Calgary 2026–2035)

Demographic and engagement analytics of youth services in Calgary — exploring equity and participation through data visualization.

View dashboard →

Explore All Dashboards & Stories

Browse engineering projects alongside city dashboards in Civic & Social Analytics, Public Health Analytics, Crime & Disorder Insights, Housing Market Insights, and Economy & Energy. Read long-form analysis in the Blog or learn more about my background on the About page.