JithendraPrasad Morusu
Anantapur
Summary
Data Engineer skilled in Azure Databricks, Pyspark, and Airflow. Proven ability to develop data pipelines and streamline ETL processes, enhancing data accessibility and operational efficiency with 4 years of experience,
Outstanding communication skills, dedicated to maintaining up-to-date IT skills and industry knowledge.
Overview
9
9
years of professional experience
Work History
Data Engineer
Capgemini
Bengaluru
05.2024 - Current
- Created DAG from Airflow to trigger multiple spark jobs in Databricks.
- Developed data pipelines to streamline data extraction and transformation from datalake, enhancing data accessibility for analysis.
- Integrated data pipelines with Airflow to trigger jobs.
- Transformed data using bronze, silver, and gold layers with delta tables, optimizing data processing with pyspark.
- Involved in code promotion to higher environments using azure devops CI/CD pipelines
- Analyzed business logic to create pyspark code aligned with business requirements, ensuring accurate data representation.
- Actively participated in PI planning events and provided key inputs and effort estimations.
Data Engineer
Tata consultancy services
Bengaluru
02.2022 - 04.2024
- Designed and developed Dynamic Metadata-driven pipelines to perform data ingestion from SFTP, Azure BLOB and Relational Databases to different layers into the ADLS Gen2 using Azure Data Factory(ADFV2).
- Executed end-to-end ETL processes including data extraction, migration, transformation, cleansing, and loading, while utilizing ADF components like Integration Runtime, Linked Services, Data Sets, Pipelines, Activities, and Triggers.
- Utilized Azure Data Factory activities such as Copy, Lookup, GetMetadata, if-condition, for-each, Execute pipeline, and Filter to streamline data processing workflows.
- Developed pyspark scripts to load data into dataframes and worked on transformations
Software Engineer
Genpact India Pvt Ltd
Bengaluru
12.2019 - 02.2022
- Collaborated in initial discussion and Scrum meetings with Project Manager, Architect, Business Analyst, and Developers to clarify business logic for development.
- Acquired domain knowledge and executed data loading from on-premise SQL server to Azure cloud.
- Responsible for full load and incremental data load strategy and implementation for same.
- Monitored end-to-end Data Factory pipelines and conducted root cause analysis for failure activities.
Management Trainee
Coffee day Global Ltd
Bengaluru
01.2017 - 12.2019
- Created a dashboard to ensure timely acknowledgement of POs and delivery of goods by suppliers to the designated plants. This guaranteed better supplier lead time and performance.
- Established performance KPIs for lead time, vendor-managed inventory, sustainability, supplier spend and savings, and defective parts per million to drive supplier evaluation and improvement.
- Developed a Power BI dashboard to track Supplier KPIs in order to manage and mitigate performance-related issues.
- Collected data from ERP applications like SAP to create a Power BI dashboard for tracking unapproved purchase requests and purchase orders, enhancing visibility into procurement processes.
- Comprehensive analysis of sales, forecasting & demand projection data to support crucial inventory carrying cost and buying cost.
- Conducted vendor audits to identify potential alternative suppliers.
Education
MBA - Retail Management
MS Ramaiah Institute of Management Studies
Bengaluru05-2017
B.Tech - Mechanical Engineering
Annamachrya Institutes of Technology And Sciences
Rajampeta05-2015
Skills
- Azure Databricks
- Pyspark
- Azure Data Factory
- Airflow
- Python
- SQL server
- Data Warehousing
- GitHub
Languages
English
Advanced (C1)
C1
Telugu
Advanced (C1)
C1
Kannada
Upper Intermediate (B2)
B2
Timeline
Data Engineer
Capgemini
05.2024 - Current
Data Engineer
Tata consultancy services
02.2022 - 04.2024
Software Engineer
Genpact India Pvt Ltd
12.2019 - 02.2022
Management Trainee
Coffee day Global Ltd
01.2017 - 12.2019
MBA - Retail Management
MS Ramaiah Institute of Management Studies
B.Tech - Mechanical Engineering
Annamachrya Institutes of Technology And Sciences