RUTUL HATWAR
Nagpur
Summary
Data Engineer Associate with six years of experience in designing, developing, and optimizing data pipelines. Proficient in leveraging Azure Databricks, Apache Spark, and a variety of data technologies to drive data-driven solutions. Seeking a challenging opportunity to apply my expertise in data engineering to create valuable insights, and drive business growth.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Data Engineer
TATA CONSULTANCY SERVICES
09.2023 - Current
- Migration of ETL jobs from SAP BODS to Spark
- Optimized data aggregation jobs
- Designed, developed, and maintained data pipelines using Azure Databricks, Apache Spark, and Python.
- Automated ETL processes, resulting in a 40 % reduction in data processing time.
- Conducted performance tuning, cluster optimization, and query optimization for improved data processing.
- Used Databricks notebooks for data exploration and analysis.
- Set up and configured Databricks clusters for performance and scalability.
ETL Developer
TATA CONSULTANCY SERVICES
01.2020 - 07.2023
- Proficient in SAP BusinessObjects Data Services (BODS) for ETL development and data integration.
- Strong knowledge of data warehousing concepts, data modeling, and data transformation techniques.
- Extracted data from various sources, including databases, flat files, Expertise in creating ETL jobs, data mapping, and workflows.
- Skilled in data quality management, data cleansing, and data validation. Strong problem-solving and analytical skills with attention to detail.
- Strong problem solving and analytical skills with attentio n
Education
B.E - Computer Science
Nagpur, Maharashtra, India01.2019
Skills
- Data engineering
- ETL tools
- pyspark
- PYTHON
- Sap Bods
- Oracle SQL
- Azure
- EXCEL
- Azure Data Factory
- Azure Databricks
- Azure Key Vault
Certification
Microsoft Azure Data Engineer (DP-203)
Timeline
Data Engineer
TATA CONSULTANCY SERVICES
09.2023 - Current
ETL Developer
TATA CONSULTANCY SERVICES
01.2020 - 07.2023