KOMALI CHALAMALASETTY

Project: Marks and Spencer.| Domain:Retail

• Technologies Used: Azure Data Lake, Delta Lake, Azure SQL, Azure Databricks, PySpark, Azure Data Factory, Azure Synapse Analytics.
• Led the migration of Marks & Spencer's business data to Azure, architecting solutions for Azure Data Lake as a centralized storage repository, and Delta Lake for improved data consistency and reliability.
• Designed, developed, and migrated their big data analytics platforms that hold data for reporting to Azure SQL Database and Azure Data Lake.
• Designed and implemented end-to-end ETL solutions using Azure Data Factory.
• Created pipelines in ADF using linked services/datasets to connect various data sources and destinations, enabling seamless data integration, transformation, and movement across cloud platforms such as Azure Blob Storage, Azure SQL Database, and Azure Data Lake.
• Optimized data pipelines for large-scale data processing, reducing data processing time using Azure Databricks and Apache Spark.
• Worked on the HUE interface, created data models, cleaned data to prepare for analysis, and have good knowledge of big data technologies like Hadoop, Hive, and Spark.
• Supported the deployment and maintenance of Azure-based solutions in production environments.