Modern international e-commerce platforms handle massive streams of real-time clickstream data. Processing this data effectively requires solving two primary operational and architectural bottlenecks:
High-Velocity Fraud Attacks: Detecting bot networks or malicious actors triggering geographical events across multiple countries within milliseconds.
Multi-Currency FinOps Consolidation: Standardizing localized transactional currencies (INR, EUR, GBP) to a unified currency (USD) for real-time executive analytics and FinOps cost tracking.
To tackle these challenges at cloud scale, I architected and deployed an end-to-end Medallion Lakehouse Architecture using Microsoft Fabric , Azure Data Lake Storage Gen2 (ADLS Gen2) , PySpark , and T-SQL .
🏗️ End-to-End System Architecture
Below is the high-level system architecture illustrating data flow from ingestion to serving:
Technology Stack & Services:
Storage & Virtualization: ADLS Gen2, Microsoft Fabric OneLake, OneLake Shortcuts, Azure Key Vault
Silver…