JESSIE NIKITHA RENTAPALLI
Senior Data Engineer
hyderabad,Telangana
Summary
Data engineer with 5.6 years of experience developing and optimizing data pipelines and big data solutions. Proficient in Amazon Web services (GLUE, S3, REDSHIFT, ATHENA) to optimize data modeling. ETL processes, and data warehousing solutions. Experienced in Informatica, Spark SQL, Apache Spark, Azure Databricks, Snowflake and Agile software development. Collaborative team player with strong communication skills focused on delivering innovative solutions aligned with business needs.
Overview
6
6
years of professional experience
5
5
years of post-secondary education
3
3
Languages
Work History
Senior Data Engineer
IMPETUS TECHNOLOGIES
04.2024 - Current
- Developed and optimized upto 430 end-to-end ETL workflows using Airflow and glue jobs to process and transform large volumes of data.
- Build and optimize distributed data processing tasks using PySpark, ensuring high scalability and performance in data pipelines.
- Perform data cleansing, transformation, and aggregation tasks using PySpark and spark SQL, ensuring data quality and consistency across large datasets.
- Integrate data from various sources including relational databases and external files into glue jobs for further analysis and processing.
- Analyze and optimize Glue jobs, Redshift and iceberg queries for better performance, reducing run time and improving resource utilization.
- Work closely with Clients to understand data requirements and provide clean, well-structured data for automating their ETL Logics.
- Ensure data security and compliance by implementing appropriate access controls, data encryption, and audit logging.
- Perform troubleshooting and debugging of Glue jobs and Redshift and iceberg queries to identify and resolve issues related to data processing and system performance.
- Document processes, workflows, and optimizations for knowledge sharing and future reference.
- Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.
- Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
- Provided support in kTs, picking challenges and worked together as a team whenever required to drive towards a common goal.
- Delivered all project milestones on time, effectively managed daily tasks, optimized project performance, and taken ownership of framework-related changes.
Senior Software Engineer
IMPETUS TECHNOLOGIES
06.2023 - 03.2024
- This project involves migration of ETL logic from informatica to AWS glue jobs using python framework and spark SQL using different databases like SQL server, oracle, db2, Netezza and file reading ad also conversion of shell script commands to python utilities.
- Conversion and development of code as per the informatica logic.
- Developed shell script logic conversion into python script for framework development.
- Supported the team wherever required in framework enhancements, testing and critical issues.
- UIT and CLV testing.
- Regularly reviewed peers'' code contributions, offering constructive feedback to enhance overall product quality.
- Mentored junior developers, fostering professional growth and enhancing team productivity.
- Proactively identified areas for process improvement, implementing changes that led to significant time savings for the team.
Senior software engineer
IMPETUS TECHNOLOGIES
03.2023 - 05.2023
- Les Mousquetaire project involves migration of ETL logic from DataStage to data bricks notebook using delta lake tables.
- Worked in conversion of DataStage logic to notebook.
- Testing and running DataStage jobs replacing the Teradata sources with jdbc connections.
- Involved in shell script conversion to notebook.
Associate Data engineer
IMPETUS TECHNOLOGIES
09.2022 - 02.2023
- It involves conversion of informatica ETL logic to AWS glue jobs with necessary enhancements in the code behavior as per client requirements.
- Migration of Informatica Etl logics to Glue jobs by developing the informatica jobs to Glue jobs.
- Ensuring code accuracy of the converted code with the original informatica ETL logic.
- Workflow execution and performance optimization.
Senior Software Engineer
INFOSYS LIMITED
11.2019 - 03.2020
- Involves researching optimum solutions for a given Big Data problem using Hadoop, Hive, spark-SQL and other related technologies.
- Analyzing the given problem statement, Developing, optimizing queries and Automating jobs.
- Providing production support on critical issues.
- Extensively worked on Spark Core, Spark SQL, Hive, MySQL, and oracle database to build next generation analytic platform.
- Expertise in Building Complex Hive queries with partitions, bucketing and joins for efficient data access and performance optimization.
- Involved in setting up Cluster configuration, developing scripts and automating business workflow and improving productivity.
Education
B.Tech - Electrical Engineering
Gayatri Vidya Parishad College of Engineering
01.2015 - 01.2019
Intermediate -
Chaitanya Junior College
01.2014 - 01.2015
Skills
Proficient in Python programming
Informatica expertise
Amazon Web Services expertise
Proficient in Spark SQL
Database management with SQL
shell script
data Migration
ETL development
Accomplishments
- Star of the Month Award, Impetus, 01/01/23
- Star of the Month Award, Impetus, 10/01/24
Timeline
Senior Data Engineer
IMPETUS TECHNOLOGIES
04.2024 - Current
Senior Software Engineer
IMPETUS TECHNOLOGIES
06.2023 - 03.2024
Senior software engineer
IMPETUS TECHNOLOGIES
03.2023 - 05.2023
Associate Data engineer
IMPETUS TECHNOLOGIES
09.2022 - 02.2023
Senior Software Engineer
INFOSYS LIMITED
11.2019 - 03.2020
B.Tech - Electrical Engineering
Gayatri Vidya Parishad College of Engineering
01.2015 - 01.2019
Intermediate -
Chaitanya Junior College
01.2014 - 01.2015
Similar Profiles
Praful JainPraful Jain
Lead Software Engineer at Impetus TechnologiesLead Software Engineer at Impetus Technologies
Varun VarierVarun Varier
Senior UI Engineer at Impetus TechnologiesSenior UI Engineer at Impetus Technologies
Samarth TibdewalSamarth Tibdewal
Senior Analytics Engineer at Impetus TechnologiesSenior Analytics Engineer at Impetus Technologies
Sai Ravi KuchimanchiSai Ravi Kuchimanchi
Principal Specialist - GRC at SolenisPrincipal Specialist - GRC at Solenis
Utkal MahapatraUtkal Mahapatra
NC Analyst, QC and Testing Jr. Engineer at MEDHA TRACTION EQUIPMENT PVT.LTD.NC Analyst, QC and Testing Jr. Engineer at MEDHA TRACTION EQUIPMENT PVT.LTD.