Unified E-Commerce Analytics Framework with On-Premises Data Integration and Azure Cloud
Umme Rumana Rumana
Paper Contents
Abstract
The rapid growth of e-commerce has led to an explosion of transactional and customer interaction data. Traditional on-premises infrastructures often struggle to manage this scale due to limited scalability, lack of real-time capabilities, and weak governance mechanisms. To address these challenges, this study presents a cloud-based analytics framework that integrates structured data from SQL Server with semi-structured clickstream logs. The data pipeline is orchestrated through Azure Data Factory and stored in Azure Data Lake Storage Gen2. Data transformation follows the Medallion Architecture in Azure Databricks, while Unity Catalog enforces governance and secure access. Power BI dashboards deliver interactive visualizations for decision-making. The proposed solution demonstrates seamless integration of heterogeneous data, improved data quality, and scalable analytics, providing organizations with a clear path to migrate from legacy systems to cloud-native platforms.Keywords: E-Commerce, Cloud Computing, Azure Data Factory, Azure Data Lake Storage Gen2, Medallion Architecture, Power BI, Data Engineering
Copyright
Copyright © 2025 Umme Rumana. This is an open access article distributed under the Creative Commons Attribution License.