Data Engineer with extensive experience in data engineering. Proven expertise in designing, developing, and automating data pipelines using AWS services. Skilled in transforming legacy data infrastructure into modern cloud-based solutions, ensuring high performance and scalability. Strong background in automation testing with Selenium, API testing, and database validation.
Overview
8
8
years of professional experience
Work History
Data Engineer
Amazon Development Center, Bangalore
03.2024 - Current
Designed and maintained automated data pipelines in AWS Glue, leveraging SQL and Python, improving data accessibility and processing efficiency.
Developed integration processes for ITA-Workforce Intelligence,Global Procurement Organization (GPO),Global Auditing Tool (GAT), and Supplier Check-in (SCIO) applications.
Implemented Apache Iceberg table format, optimizing partitioning strategy and S3 integration for efficient storage and querying.
Automated event-driven ETL workflows using Event Bridge,Step functions,S3 and Lambda, ensuring real-time data availability.
Collaborated with cross-functional teams to define data models, ensuring consistent schema evolution and governance.
Developed documentation for onboarding processes and integration guides, streamlining team knowledge sharing.
Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
Contractual from Varite India Pvt Ltd, Bangalore
Senior Software Test Engineer
Amazon Development Center, Hyderabad
01.2024 - 02.2025
Automated API testing using REST Assured and Selenium WebDriver integrated with TestNG, reducing manual effort by 40%.
Validated data consistency in DynamoDB and MongoDB against API responses for key business applications.
Executed browser compatibility and regression testing across multiple environments.
Developed modular automation frameworks using Maven and GitHub for scheduled test executions.
Contractual from BCT Consulting Pvt Ltd
Software QA Engineer
Epethilial Tech Services LLP
05.2022 - 12.2023
Developed test plans, automated test scripts, and managed bug reporting using JIRA and Confluence.
Performed functional, system, and integration testing for fintech and banking applications.
Created test data using BVA and ECP techniques and validated data in Oracle and MongoDB.
QA Engineer
Careerpath Infotech Pvt Ltd
Hyderabad
06.2017 - 04.2022
Developed automation frameworks and wrote scripts for data-driven testing using Selenium Web driver and POI API.
Conducted web services testing using Postman and SOAP UI for credit card and loan processing applications.
Managed continuous integration pipelines using Jenkins and Perforce.
Contributed to development of company-wide QA strategy, aligning testing processes with business goals.
Coordinated with customer support teams to understand user complaints and prioritize testing efforts accordingly.
Optimized test environments for more efficient test execution, contributing to shorter development cycles.
Education
Bachelor of Science - EEE
Jawaharalal Nehru Technological University
Kakinada
01.2014
Skills
Programming Languages: Python,SQL,Java,TypeScript
ETL development
Data migration
Data quality assurance
Data Engineering Tools: AWS Glue, AWS Lake Formation, Amazon Redshift, Amazon S3, AWS Lambda, Apache Iceberg
Frameworks: Apache Spark, Apache Airflow, Cypress
Databases: Oracle, MSSQL, DynamoDB, MongoDB
Web Technologies: HTML, XML
Automation Frameworks: Selenium Web Driver, REST Assured, TestNG
Cloud: AWS (Kinesis, Event Bridge, IAM)
Version Control & CI/CD: Git, GitHub, Jenkins, Maven
Lead SERVICE ANALYST - RESILIENCY MANAGER at Societe Generale Global Solutions Center Pvt Ltd, Bangalore | Bangalore, INDIALead SERVICE ANALYST - RESILIENCY MANAGER at Societe Generale Global Solutions Center Pvt Ltd, Bangalore | Bangalore, INDIA