Summary
Overview
Work History
Education
Skills
Projects
Accomplishments
Timeline
Generic

Madhusudhan K

Bangalore

Summary

Azure Data Engineer with over 4 years of experience designing and optimizing scalable data pipelines and ETL processes across Agriculture, Real Estate, and Travel & Hospitality domains. Proficient in Azure services such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Azure Synapse Analytics for creating robust data solutions. Expertise in Python, PySpark, and SQL for data transformations, processing, and analysis, driving insights for business intelligence and advanced analytics. Adept in utilizing Delta Lake for reliable, ACID-compliant data storage, supporting historical data analysis and real-time data processing for efficient decision-making. Experience in building real-time data pipelines for agriculture production analysis, real estate transaction management, and personalized customer experiences in Travel & Hospitality. Knowledgeable in data security and compliance, ensuring that pipelines adhere to data protection standards and handle sensitive data securely. Skilled in Agile methodologies, collaborating with business stakeholders and technical teams using Jira, GitHub, and Azure DevOps for CI/CD automation. Competent in building data visualization dashboards using Power BI to support real-time analytics and provide stakeholders with actionable insights for decision-making.

Overview

4
4
years of professional experience

Work History

Azure Data Engineer

Free kyat Systems
Bangalore
10.2023 - Current
  • Designed and developed data pipelines for an agriculture company, enabling real-time monitoring of crop production and optimizing supply chain management
  • Developed Azure Data Factory pipelines to ingest sensor data from IoT devices installed on farms, processing data related to soil conditions, crop health, and weather patterns into Azure Data Lake Storage
  • Implemented PySpark transformations in Azure Databricks to process and clean IoT data, enabling predictive analytics for crop yield and resource management
  • Utilized Delta Lake to store both batch and real-time data, ensuring reliable access to historical data for farm management and decision-making
  • Integrated Azure Synapse Analytics for querying and reporting on crop production trends and resource usage, providing insights into optimizing agricultural processes
  • Built Power BI dashboards for real-time monitoring of farm performance, enabling stakeholders to make data-driven decisions for crop management and resource allocation
  • Collaborated with agronomists and farm managers to gather requirements and ensure that the data solutions aligned with operational needs
  • Used GitHub and Azure DevOps to implement CI/CD pipelines, ensuring efficient deployment of data processing jobs and minimizing downtime
  • Client: Greenfield Analytics

Data Engineer

Free kyat Systems
Bangalore
08.2022 - 10.2023
  • Developed a comprehensive data processing platform for real estate transactions, enabling accurate pricing analytics, property listings, and transaction tracking
  • Created and optimized Azure Data Factory pipelines to ingest real estate transaction data from multiple sources, including property listings, customer inquiries, and market analytics data
  • Used PySpark in Azure Databricks to perform data transformations, such as cleaning, aggregation, and filtering, for property pricing models and transaction tracking
  • Leveraged Delta Lake for efficient and secure storage of transactional data, enabling accurate historical analysis of real estate market trends
  • Worked with data scientists to implement machine learning models to predict property price trends and customer buying patterns, enabling personalized recommendations
  • Created custom reports and dashboards in Power BI, providing real-time insights into property trends and market fluctuations for real estate agents and investors
  • Implemented CI/CD pipelines using GitHub and Azure DevOps, automating the deployment of new features and data updates, ensuring smooth operations
  • Collaborated with legal and compliance teams to ensure data processing adhered to real estate industry regulations and privacy standards
  • Client: RealtyTech Solutions

Associate Data Engineer

Free kyat Systems
Bangalore
01.2021 - 08.2022
  • Developed a data platform for a travel and hospitality company to personalize customer experiences and optimize booking management and revenue strategies
  • Built ETL pipelines using Azure Data Factory to consolidate customer booking data, feedback, and transaction records from various travel platforms into Azure Data Lake Gen2
  • Utilized PySpark in Azure Databricks to process and transform customer data, applying segmentation and personalization logic to support targeted marketing campaigns
  • Integrated Delta Lake for real-time and batch processing, enabling seamless data access for personalized recommendations and customer interaction insights
  • Collaborated with the marketing team to develop personalized offers for customers, using predictive analytics models built by data scientists for enhancing customer engagement
  • Created Power BI dashboards for travel agents and hospitality managers to track bookings, occupancy rates, and customer satisfaction in real time, enabling data-driven decisions for revenue optimization
  • Used GitHub for version control and Azure DevOps for automating the deployment of data pipelines, ensuring faster feature updates and process improvements
  • Worked closely with data privacy teams to ensure compliance with GDPR and other regulatory standards, safeguarding sensitive customer data
  • Client: TravelTech Innovations

Education

B-Pharmacy -

Rajiv Gandhi Health University
Bangalore
01-2010

Skills

  • Programming Languages: Python, PySpark, SQL
  • Cloud Technologies: Microsoft Azure (Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Synapse Analytics)
  • Data Storage & Processing: Azure Data Lake Storage Gen2, Delta Lake, Azure SQL Database, Azure Synapse
  • Data Integration Tools: Azure Data Factory (ADF), Databricks Notebooks
  • Version Control & CI/CD: GitHub, Azure DevOps, Jenkins
  • Project Management Tools: Jira
  • Data Warehousing & BI: Snowflake, Power BI

Projects

Agriculture IoT Data Pipeline: Developed a real-time data pipeline for monitoring crop production and resource management, increasing crop yield forecasting accuracy by 30%., Real Estate Transaction Platform: Built a centralized data platform for real estate transactions, improving pricing analytics and reducing transaction errors by 25%., Travel & Hospitality Customer Experience: Developed a personalized customer experience platform, improving customer engagement and booking conversions by 20%.

Accomplishments

  • Recognized for streamlining loT data processing in the agriculture domain, reducing data latency by 25%.
  • Successfully implemented predictive analytics for personalized customer experiences, increasing customer retention by 15% for a travel and hospitality client.
  • Awarded 'Data Engineer of the Quarter' for contributions to the real estate transaction analytics platform.

Timeline

Azure Data Engineer

Free kyat Systems
10.2023 - Current

Data Engineer

Free kyat Systems
08.2022 - 10.2023

Associate Data Engineer

Free kyat Systems
01.2021 - 08.2022

B-Pharmacy -

Rajiv Gandhi Health University

Similar Profiles

CREATE PROFILE
Madhusudhan K