Galiy Patel
Bengaluru
Summary
Results-driven Data Engineer with 4 years of experience at Enquero, skilled in AWS Glue and Spark. Achieved a 30% reduction in data processing time through innovative pipeline design. Proficient in SQL and adept at collaborating with cross-functional teams to deliver scalable ETL solutions, ensuring efficient data management and integration across cloud platforms.
Overview
4
4
years of professional experience
Work History
Data Engineer
Enquero - A Genpact Company
Bengaluru
12.2021 - Current
- Created stored procedures for automating periodic tasks in SQL Server.
- Utilized informatica Powercentre to manage and orchestrate ETL processes, ensuring smooth data migration to the cloud.
- Worked with AWS S3, EC2 and Lambda to implement scalable data storage and compute solutions for data processing workflows.
- Supported the integration of AWS Glue for data cataloging and ETL orchestration across AWS services.
- Designed and implemented real time data processing workflows using Sprak Streaming and AWS Lambda.
- Managed large scale data lakes on AWS S3, integrating them with Glue catalog for easy discovery and Querying.
- Maintained ETL processes using Informatica for loading structured and semi structured data into Hive.
Data Engineer Intern
HP
Bengaluru
11.2020 - 11.2021
- Designed and developed data pipelines using AWS Glue and Apache Spark ti process large datasets from multiple sources, reducing data processing time by 30%
- Automated the extraction and loading of data using AWS Lambda, triggering data workflows based kn event driven actions in S3.
Education
Bachelor of Engineering Technology - Electrical, Electronics Engineering
East Point College of Engineering And Technology
Bengaluru08-2020
Skills
- Big Data and ETL Tools : AWS Goue, Hive, Spark , Informatica
- Programming Languages: SQL, Shell scripting, Python
- Databases: MySQL, PostgresSQL
- Cloud Platforms: AWS(EC2, S3, Lambda, Glue, Athena)
- Data Warehousing: Hive ,Snowflake
- Operating Systems: Linux, Windows
Languages
Hindi
First Language
English
Proficient
C2
Spanish
Intermediate
B1
Timeline
Data Engineer
Enquero - A Genpact Company
12.2021 - Current
Data Engineer Intern
HP
11.2020 - 11.2021
Bachelor of Engineering Technology - Electrical, Electronics Engineering
East Point College of Engineering And Technology