Data Engineer equipped with 5+ years of extensive experience in application development. Employs excellent leadership skills and multi-tasking strengths. Demonstrated ability to improve data operations.
Overview
10
10
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Mindtree Ltd.
06.2021 - Current
Developing ETL design & end to end solution using GCP services.
Developing dataflow pipelines (Stream/batch), cloud functions, standard-SQL (Big Query), airflow jobs etc.
Maintaining/building data warehouse and analytics environment.
Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
Architecting and designing data warehouse and data lake, data models using GCP data store such as Big query.
Visualizing summary data using Data studio.
Automating different parts of the development process.
Data Engineer
TabSquare Private Ltd.
01.2021 - 06.2021
Designed data warehouse solution using GCP services.
Developed solution using (dataflow pipelines, airflow jobs) for processing large datasets, which reduced the job timing from 2 hours to 10 minutes.
Developed solution to provide near real time analytics on data instead of delayed data.
Validating data across the files and databases, end to end along with negative test scenarios to verify the performance and to avoid junk data in the source, Target.
Application Developer
Tata Consultancy Services Ltd.
09.2018 - 01.2021
Developed StreamSets pipelines to migrate data from origins like (SQL Server, Oracle, PostgreSQL) to GCP destinations (Google cloud bucket, Big Query) or vice-versa.
Developed dataflow pipelines for batch data processing using Apache Beam and python.
Developed SQL scripts for managing tables in Cloud SQL and remotely trigger them using python-based cloud functions.
Responsible for design and development of big data solutions.
Application Developer
Tata Consultancy Services Ltd.
09.2017 - 08.2018
Developed hive QL that works seamlessly on Hadoop clusters.
Developed Spark/Pyspark code to process unstructured data and storing in HDFS.
Extracting out derived information by implementing complex queries for Hive and storing results in derived tables, basically ETL operations.
Managing workflows and scheduling oozie jobs with Python and shell-scripting or through web interface.
Trainee
Tata Consultancy Services Ltd.
06.2017 - 09.2017
Attended internal training on Java, along with the practical hands-on live projects.
Attended internal training on Hadoop tools and their fundamentals under expert’s guidance.
Intern
Maxgen Technologies Pvt. Ltd.
06.2016 - 07.2016
Developed java-based modules for live project of library system under expert’s guidance.
My role include gathering requirements from experts, developing modules by writing code, maintenance troubleshooting and debugging.
Red Hat Certified System Administrator (RHCSA EX-200)
Red Hat Certified Engineer (RHCE EX-300)
Accomplishments
Smart India Hackathon, 04/01/17, Top -8 listed team in Smart India Hackathon (2017) with project River monitoring System in Indian forest ministry.
TCS–CodeVita Season 5, 07/01/16 - 09/01/16, Cleared TCS code vita season 5 (round1 and round2) and got offer from TCS.
Inter Account Competition, 01/01/16 - 09/01/16, Basketball, Volleyball, Throw ball winner for HUMANA account in TCS.
Languages
English
Hindi
Rajasthani
Hobbies and Interests
Basketball
Cricket
Snooker
Painting
Watching Scientific-Fictions
Training
Tata Consultancy Services Ltd., Trainee (Initial Learning Program), 06/01/17, 09/01/17, Hyderabad, Telangana, Attended internal training on Java, along with the practical hands-on live projects., Attended internal training on Hadoop tools and their fundamentals under expert’s guidance.
Maxgen Technologies Pvt. Ltd., Intern (Java developer), 06/01/16, 07/01/16, Pune, Maharashtra, Developed java-based modules for live project of library system under expert’s guidance., My role included gathering requirements from experts, developing modules by writing code, maintenance troubleshooting and debugging.
Disclaimer
I hereby solemnly declare that all the statements made above are true to the best of my knowledge and Belief and nothing has been concealed, suppressed or fabricated.
Senior Data Engineer at Equinix (Contract role through eTeam info services Pvt Ltd)Senior Data Engineer at Equinix (Contract role through eTeam info services Pvt Ltd)