Ramesh Maliki
A.P
Summary
Seasoned professional with over 8.1 years of experience in Microsoft Azure Cloud Computing and ETL Development. Expertise in Azure components including Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure Blob Storage, Azure SQL Database, Logic Apps, Key Vault, PySpark, and Delta Lake. Proven track record in building efficient pipelines for data processing, transformation, management, and computation within Azure Data Factory. Skilled in scheduling and monitoring pipelines for seamless data flow. Proficient in using Azure Databricks and PySpark for data cleaning, transformation, and analysis. Holds certifications in AZ-900 and DP-203 with knowledge of Azure Synapse, Python, and Microsoft Fabric. Experienced in data warehousing using ETL techniques for data extraction, transformation, and loading.
Overview
11
11
years of professional experience
1
1
Certification
Work History
Sr. Data Engineer
NTT Data Information Processing Services
02.2025 - Current
- Designed and implemented ETL pipelines using ADF, Azure Databricks, and PySpark to process large-scale structured and unstructured data into ADLS.
- Built Delta Lake architecture for batch and streaming data processing with PySpark and SQL for advanced transformations and aggregations.
- Developed and optimized PySpark SQL queries for data validation, transformations, and integration with downstream systems.
- Optimized pipeline performance by implementing partitioning, caching, and parallelism in PySpark jobs.
- Ensured data security with Azure Key Vault, encryption for data at rest and in transit.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Compiled, cleaned and manipulated data for proper handling.
Sr.Data Engineer
DXC Technology
04.2023 - 05.2024
- Developed data pipelines using ADF to automate data movement between various sources and sinks
- Configured data transformations and data cleansing within pipelines
- Scheduling and monitoring pipeline execution
- Perform complex data transformations and aggregations on large datasets
- Utilized Pyspark for cleaning, transforming, and analyzing datasets
- Developed automated data pipelines using Pyspark for data ingestion, transformation, and loading
- Optimized Spark jobs for performance and scalability.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
Data Engineer
ITC Infotech
12.2021 - 01.2023
- Involved in Business requirement document walk through to understand functionality
- Extracted, transformed, and loaded data from source systems to Azure Data Storage services
- Created pipelines in Azure Data Factory for batch job automation
- Ingested data to Azure Services like Azure Data Lake, Azure SQL, Azure Synapse using Azure Data bricks
- Used Spark-SQL for faster data processing and testing
- Interacted with client teams to gain better understanding of their deployment needs.
Application Development Analyst
Accenture Solutions
12.2020 - 10.2021
- Worked with Microsoft Azure Components like Data factory, to move data from on premises database to Azure database via azure portal
- Requirement gathering from Client and provide better solutions
- Map source system data elements to target system and develop, test, and support extraction, transformation, and load processes
- Developed Pipelines in Azure Data factory using Multiple Activities
- Integrated data from on-premises like ORACLE, and BLOB Source to Azure Data Lake Store (ADLS)
- Created Pipelines, Datasets using activities for automatic data integration in Azure Data factory
- Created Scheduled based, Event based, Tumbling window triggers on demand basis
- Performed Data Validation and Data Quality checks after completion of Data ingestion
Consultant
Capgemini
11.2016 - 11.2019
- Participated in business process walk through to understand functionality
- Analyzed Transformation rules using mapping rule document
- Understanding business requirement and functional requirements specification and documenting test scenarios, test cases, test execution, defect management, status reporting
- Coordinating with different teams for doing end to end testing
- Running workflows and shell scripts to validate results
- Involved in ETL validations like Structure Validations, Count Validation, Constraint Validations, Duplicate check validations and data validations
Software Engineer
Extarc Software solution
09.2014 - 10.2016
- Participated in business process walk through to understand functionality
- Analyzed Transformation rules using mapping rule document
- Understanding business requirement and functional requirements specification and documenting test scenarios, test cases, test execution, defect management, status reporting
- Coordinating with different teams for doing end to end testing
- Running workflows and shell scripts to validate results
- Involved in ETL validations like Structure Validations, Count Validation, Constraint Validations, Duplicate check validations and data validations
- Attending weekly dev sync up calls with development teams for project discussions and participating triage (defect) calls.
Education
Bachelor of Technology (B.Tech) - ECE
JNTU
Skills
- Experience with Azure Data Factory
- Azure Data Lake Storage
- Azure Databricks expertise
- Delta Lake management
- Pyspark development
- Skilled in Python development
- SQL
- Skilled in utilizing Microsoft Fabric
Certification
- AZ-900
- DP-203
Personal Information
Timeline
Sr. Data Engineer
NTT Data Information Processing Services
02.2025 - Current
Sr.Data Engineer
DXC Technology
04.2023 - 05.2024
Data Engineer
ITC Infotech
12.2021 - 01.2023
Application Development Analyst
Accenture Solutions
12.2020 - 10.2021
Consultant
Capgemini
11.2016 - 11.2019
Software Engineer
Extarc Software solution
09.2014 - 10.2016
Bachelor of Technology (B.Tech) - ECE
JNTU
Similar Profiles
Lokesh GautamLokesh Gautam
F & A Operations Processing Analyst (TL/SME) at NTT DATA Information Processing Services Pvt LtdF & A Operations Processing Analyst (TL/SME) at NTT DATA Information Processing Services Pvt Ltd
Deepti KantDeepti Kant
Project Delivery Manager at NTT Data Information Processing ServicesProject Delivery Manager at NTT Data Information Processing Services
Girish Kumar VGirish Kumar V
System Integration Senior Specialist at NTT DATA Information Processing Services Pvt. LtdSystem Integration Senior Specialist at NTT DATA Information Processing Services Pvt. Ltd
NALLAGONDA BHAVANARAYANANALLAGONDA BHAVANARAYANA
Liaison Officer (GIS) at Andhra Pradesh Industrial Infrastructure CorporatiLiaison Officer (GIS) at Andhra Pradesh Industrial Infrastructure Corporati
Narashimha NNarashimha N
Public Relations Manager at Alluri Sitarama Raju Academy of Medical SciencesPublic Relations Manager at Alluri Sitarama Raju Academy of Medical Sciences