Data Pipeline Migration

Context: Global commodity pricing platform where editorial teams relied on fragile Excel-Access macro chains for price calculations and data feeds.

Challenge: Legacy pipelines required 1–6 hours of manual processing per pricing update. Cross-file dependencies made maintenance error‑prone and scaling impossible.

Solution: Architected and executed a full migration:

• Migrated 4 legacy pipelines from Excel‑Access to Oracle + R Shiny
• Automated data validation and quality assurance for every price and process
• Built scalable, auditable, real‑time dashboards serving 12 commodity categories including crude oil, LPG, coal, agriculture, chemicals, and metals

Outcome: Eliminated manual processing bottlenecks, improved data integrity, and enabled the 600+ editorial team to publish 40,000+ live price data points globally with confidence.