G CH
Hyderabad
Summary
Accomplished Sr. Data Engineer with expertise in developing data pipelines and optimizing ETL processes. Proven ability to ensure data quality and drive collaboration across cross-functional teams.
Overview
10
10
years of professional experience
Work History
Sr Data Engineer
CT
Hyderabad
05.2021 - Current
- Developed data pipelines using Apache Spark and Hadoop frameworks.
- Collaborated with cross-functional teams to define data requirements and solutions.
- Designed and optimized ETL processes for efficient data integration.
- Implemented data quality checks to ensure accuracy and reliability of datasets.
- Automated reporting processes using SQL and Python scripts.
- Conducted performance tuning of database systems for improved efficiency.
- Created ETL scripts to move and transform data from various sources into a centralized repository.
- Developed data pipelines to ingest and process large datasets.
- Collaborated with other teams to understand their requirements and deliver solutions accordingly.
- Integrated multiple heterogeneous sources into one unified source via ETL processes.
- Optimized existing queries in order to improve query performance and reduce the load on the server.
- Managed security protocols and access control policies within the organization's databases and systems.
- Monitored system health and performance metrics to ensure smooth functioning of the system.
- Analyzed user needs and created logical models that met those needs while adhering to industry standards.
Software Engineer
CN
Chennai
03.2015 - 05.2021
- Developed software solutions using Agile methodologies for client projects.
- Collaborated with cross-functional teams to gather requirements and design applications.
- Developed, tested, debugged and documented software programs using Java, JavaScript and HTML and CSS.
Skills
- Data pipeline development
- ETL optimization
- Apache Spark expertise
- Data quality assurance
- Problem solving
- Project adaptability
- Performance tuning
- Big data processing
- Microsoft Azure proficiency
- Cross-functional collaboration
Core
competency
Core Competencies
- DataBricks
- Azure ecosystem
- Azure Data Factory
- Data engineering
Timeline
Sr Data Engineer
CT
05.2021 - Current
Software Engineer
CN
03.2015 - 05.2021
Similar Profiles
Cristopher Tevez OcampoCristopher Tevez Ocampo
MIS LOGROS MAS IMPORTATES at CTMIS LOGROS MAS IMPORTATES at CT
Pamela HumphreyPamela Humphrey
Accounts-Payable-Specialist at Town Of Canton CT / BOE Canton CTAccounts-Payable-Specialist at Town Of Canton CT / BOE Canton CT
Yesenia CardonaYesenia Cardona
Secretary 2 at State of CT/ Southern CT State UniversitySecretary 2 at State of CT/ Southern CT State University
SRINIVAS NEELAMSRINIVAS NEELAM
Senior Service Engineer at S SCIENTIFIC INSTRUMENTSSenior Service Engineer at S SCIENTIFIC INSTRUMENTS
Naga Durga Sainath SomisettyNaga Durga Sainath Somisetty
Planning In Charge at Larsen And Toubro ConstructionPlanning In Charge at Larsen And Toubro Construction