MADHUSUDHAN REDDY CHILUKURI
Warangal
Summary
Experienced Data Engineer with over 6 years of expertise in designing and implementing Data pipelines, ETL processes, and system integrations. Proficient in Azure Data Factory, Spark, Logic Apps, and Power Automate, with a proven track record of delivering complex data solutions across multiple industries. Skilled in cloud platforms like Azure, Databricks, Synapse Analytics, Snowflake, with hands-on experience in data migrations, automation, and performance optimization. Adept at collaborating with cross- functional teams to streamline operations and drive business outcomes.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Developer
KPI Partners India PVT LTD
03.2023 - 05.2024
- Developed Azure Data Factory pipelines to copy data between multiple data sources like MySQL, external API, SQL Server, Postgress to Snowflake Data Warehouse
- Developed Data Pipelines: Built Azure Data Factory pipelines for SQL Server, Snowflake, and Azure SQL DB integrations
- Managed Configurations: Created configuration tables for dynamic job types, schema mappings, and incremental loads
- Data Extraction & Transformation: Extracted and transformed data from APIs using Python (Pandas, NumPy, OpenCV, DASK) and PySpark
- Automated Workflows: Automated data migration using ADF and Rundeck with failover and retry mechanisms
- Optimized Data Processing: Designed generic pipelines for API data to bronze, silver, and gold layers
- Implemented Logging & Quality Control: Ensured data quality, handled errors effectively, and maintained robust logging
- Collaborated with Teams: Worked with cross-functional teams to implement scalable data solutions
- Developed ETL Solutions: Created reusable ETL workflows in ADF and Databricks for efficient data transformation
- Collaborated with cross-functional teams to ensure seamless integration of new features.
- Adapted quickly to new technologies and programming languages, enhancing overall team productivity.
- Debugged complex software issues, leading to a more stable product release.
- Continuously updated skills through training courses, workshops, and self-study—staying current on industry trends and emerging technologies.
Developer
CAPGEMINI
07.2021 - 03.2023
- Developed Azure Data Factory pipelines to copy data between subscriptions on a scheduled basis
- Created data flows to generate door-level files with upsert operations
- Conducted unit testing of pipelines and participated in business calls to gather requirements
- Developed ETL jobs in PySpark to perform complex data transformations
- Migrated historical data using ADF pipelines
Application Developer
Leading Torch India Pvt Ltd
11.2019 - 05.2021
- Developed PySpark scripts to transform data and generate reports as per business requirements
- Built workflows using Azure Logic Apps and Function Apps for data integration and automation
- Created and conducted unit tests for PySpark notebooks and Logic Apps to validate data processing
- Collaborated with different teams to gather inputs, provide technical guidance, and ensure project alignment
- Set up core Azure resources, including resource groups, key vaults, Databricks clusters, and Blob Storage, to support project requirements
Associate
Indian Financial Technology & Allied Services (Subsidiary of RBI)
07.2018 - 10.2019
- Developed and deployed a leave management system using PowerApps, Power Automate, and Dataverse, integrating with SharePoint for data storage
- Automated data retrieval from Zoom and CVENT APIs using Logic Apps, reducing manual intervention and streamlining the process
- Built workflows to process data from external sources into a structured format for storage and further analysis
- Configured Azure resources such as Blob Storage, Key Vaults, and Azure SQL DB for data management and integration
- Utilized Power Automate and Logic Apps to automate business processes, enhancing operational efficiency
Education
B.Tech - Autonomous
CVSR College of Engineering
Intermediate - State Board (A.P)
Sri Gayatri Junior college
SSC - State Board (A.P)
AP Residential High School
Skills
- Python
- PySpark
- C
- SQL Server
- Snowflake
- MongoDB
- SQL Azure
- MySQL
- Azure DevOps
- Logic Apps
- ADLS
- ADF
- Synapse Analytics
- Azure Purview
- Azure REST API's
- Delta Lake
- Databricks
- Functions Apps
- Blob Storage
- Key Vaults
- Power Automate
- Dataverse
- Drawio
- Visio
- Word
Corecompetencies
Python, PySpark, C, SQL Server, Snowflake, MongoDB, SQL Azure, MySQL, Azure DevOps, Logic Apps, ADLS, ADF, Synapse Analytics, Azure Purview, Azure REST API's, Delta Lake, Databricks, Functions Apps, Blob Storage, Key Vaults, Power Automate, Dataverse, Draw.io, Visio, Word
Personal Information
Date of Birth: 10/05/93
Awards
- Az-900, Microsoft, Microsoft certified
- Developed Two Windows Apps
- The Universe
- Mysterious World
- Selected for the MSP, Microsoft
Professional Highlights
- Optimized Data Pipelines: Reduced processing time by 40% using Azure Databricks and efficient ETL scripts.
- Successful Data Migration: Led seamless migration from on-prem databases to Azure Cloud, increasing system reliability by 30%.
- Data Integration: Developed scalable solutions with Azure Data Factory, cutting manual data handling by 50%.
- Automated Reporting: Built pipelines reducing report generation time from 12 to 2 hours, improving decision-making.
- Cloud Cost Savings: Cut cloud costs by 25% through resource optimization with Azure Synapse Analytics.
- Real-Time Processing: Designed real-time data systems, boosting client efficiency by 20%.
- Automation: Automated business processes with Power Automate, reducing overhead by 60%.
- Security Enhancements: Implemented custom SQL functions for secure SIN data handling, meeting compliance standards.
- Cross-Team Collaboration: Improved data quality by 30% through effective collaboration with key stakeholders.
- ETL Workflow Development: Managed complex ETL workflows for faster client insights.
Certification
Microsoft certified - AZ-900
Languages
English
Telugu
Accomplishments
Optimized Data Pipelines: Reduced processing time by 40% using Azure Databricks and efficient ETL scripts. • Successful Data Migration: Led seamless migration from on-prem databases to Azure Cloud, increasing system reliability by 30%. • Data Integration: Developed scalable solutions with Azure Data Factory, cutting manual data handling by 50%. • Automated Reporting: Built pipelines reducing report generation time from 12 to 2 hours, improving decision-making. • Cloud Cost Savings: Cut cloud costs by 25% through resource optimization with Azure Synapse Analytics. • Real-Time Processing: Designed real-time data systems, boosting client efficiency by 20%. • Automation: Automated business processes with Power Automate, reducing overhead by 60%. • Security Enhancements: Implemented custom SQL functions for secure SIN data handling, meeting compliance standards. • Cross-Team Collaboration: Improved data quality by 30% through effective collaboration with key stakeholders. • ETL Workflow Development: Managed complex ETL workflows for faster client insights.
Work Availability
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Timeline
Developer
KPI Partners India PVT LTD
03.2023 - 05.2024
Developer
CAPGEMINI
07.2021 - 03.2023
Application Developer
Leading Torch India Pvt Ltd
11.2019 - 05.2021
Associate
Indian Financial Technology & Allied Services (Subsidiary of RBI)
07.2018 - 10.2019
Intermediate - State Board (A.P)
Sri Gayatri Junior college
SSC - State Board (A.P)
AP Residential High School
B.Tech - Autonomous
CVSR College of Engineering
Similar Profiles
Dibya Ranjan SahooDibya Ranjan Sahoo
Associate Team Lead (Software Testing) at IVistec Partners India Pvt. Ltd. (Formerly Known As Porteck India Infoservices Pvt. Ltd.)Associate Team Lead (Software Testing) at IVistec Partners India Pvt. Ltd. (Formerly Known As Porteck India Infoservices Pvt. Ltd.)
R. David KupiecR. David Kupiec
Founder/CEO at KPI MEDIA PARTNERS LLCFounder/CEO at KPI MEDIA PARTNERS LLC
Chandana KChandana K
Lead QA Engineer at KPI PartnersLead QA Engineer at KPI Partners
SURESH NUNETISURESH NUNETI
Senior Associate at PRAMERICA LIFE INSURANCE CO, LTDSenior Associate at PRAMERICA LIFE INSURANCE CO, LTD
SRIRAM NAYAK KELOTHUSRIRAM NAYAK KELOTHU
Cycling Coach at Khelo India Cycling CentreCycling Coach at Khelo India Cycling Centre