NARASIMHA DABBARAPALLI
Chennai
Summary
Data Engineer with 2.8 years of experience designing, building, and optimizing scalable data pipelines and data infrastructure. Proficient in Python, SQL, and big data technologies such as Spark and Hadoop. Experienced in ETL/ELT processes, data warehousing, and cloud platforms like AWS/Azure. Strong ability to transform complex data into reliable datasets that support analytics and business decision-making.
Overview
3
3
years of professional experience
Work History
(UPS) Data Engineer
Hexaware Technology
Chennai
12.2023 - Current
- Gathered business requirements and participated in end-to-end design, development, and
testing of Big Data ETL pipelines. - Performed data ingestion from MS SQL Server and various source systems using OGG and Sqooq into the Hadoop ecosystem.
- Designed and developed reusable ETL framework components using Scala and Spark for
scalable data transformations through Landing, Staging, and EDL layers. - Implemented data quality, data cleansing, and validation rules before loading curated data into the Data Lake.
- Utilized BigDecisions for data profiling and quality assessment of source datasets.
- Developed shell scripts to orchestrate and trigger Spark jobs.
- Deployed applications and configured workflows using Rundeck across SIT, UAT, and Production
environments.
( EBRD ) Data Engineer
Hexaware Technology
Chennai
08.2023 - 12.2023
- Designed data pipelines for efficient data ingestion and processing.
- Developed ETL processes to ensure data quality and integrity.
- Collaborated with cross-functional teams to gather data requirements.
- Implemented data governance practices to enhance data security.
- Optimized existing database structures for improved performance.
- Provided support in troubleshooting data-related issues across projects.
- Optimized existing queries to improve query performance by creating indexes on tables.
- Analyzed user requirements, designed and developed ETL processes to load enterprise data into the Data Warehouse.
- Developed and implemented data models, database designs, data access and table maintenance codes.
- Created stored procedures for automating periodic tasks in SQL Server.
Education
Bachelor of Technology - Computer Sciences
Annamacharya Institute of Sciences And Technology
Rajampeta 07-2021
Skills
- Big Data ETL
- SQL
- Pyspark
- Python
- Oracle SQL
- ShellScript
- Hadoop
- HDFS
- Hive Scripting
- Airflow
Timeline
(UPS) Data Engineer
Hexaware Technology
12.2023 - Current
( EBRD ) Data Engineer
Hexaware Technology
08.2023 - 12.2023
Bachelor of Technology - Computer Sciences
Annamacharya Institute of Sciences And Technology