Piyush Patil
Data Engineer
Mumbai,MH
Summary
Experienced Data Engineer specializing in designing and implementing ETL and real-time data solutions using big data technologies.
Proficient in programming with expertise in scala and SQL, AWS-based data solutions, and Agile methodologies like TDD and extreme programming (XP) practices.
Overview
3
3
years of professional experience
4
4
years of post-secondary education
Work History
Deputy Manager - Data Engineer
Axis Bank
Mumbai
04.2023 - Current
- Designed and implemented a real-time health dashboard for 8 products, addressing the top three issues causing system performance degradation as reported by product owners, resolving 90% of incidents.
- Led integration of new developments across systems, aligning with organizational goals.
- Conducted knowledge-sharing sessions, fostering continuous learning.
- Proficient in data development and agile methodologies, ensuring code quality.
- Preparing and running different queries in SQL Server, taking out the reports and providing the requirements.
- Archived data for the last 3 years by creating a new S3 Bucket.
- Monitoring the platform issues and reports to team manager.
- Managing lifecycle elements of ETL development, from robust testing to final deployment.
- Optimized SQL queries for visualizing the data 40% earlier.
- Led the migration of MWAA environment to new S3 bucket which reduced the errors by 60%
Assistant Manager - Data Engineer
Axis Bank
Mumbai
07.2022 - 03.2023
- Supervised day-to-day operations to meet performance, quality and service expectations.
- Developed strong working relationships with staff, fostering a positive work environment.
- Promoted teamwork within the workplace by encouraging collaboration among staff members on various project tasks.
Education
PG-Diploma - Big Data Analytics
CDAC Banglore
Bengaluru, KA 12.2021 - 05.2022
Bachelor of Engineering - Electronics & Telecommunication
University of Pune
Nashik, India 07.2017 - 08.2020
Skills
Hive
Technological Skills
Hive, Airflow, Spark, Presto, Kafka, AWS S3, AWS MSK, AWS EC2, AWS EMR, AWS CloudWatch, Scala, SQL, Presto, MySQL, Airflow, Superset, Kibana, Grafana, Corologix, OpenSearch, ARCON PAM, Jenkins, Kubernetes, Jira, Bitbucket, MacOS, Linux,Quickworks
Timeline
Deputy Manager - Data Engineer
Axis Bank
04.2023 - Current
Assistant Manager - Data Engineer
Axis Bank
07.2022 - 03.2023
PG-Diploma - Big Data Analytics
CDAC Banglore
12.2021 - 05.2022
Bachelor of Engineering - Electronics & Telecommunication
University of Pune
07.2017 - 08.2020