Ankit Gera
Bangalore
Summary
10+ years of IT Experience in Architecture, Analysis, design, development, implementation and maintenance with experience in developing strategic methods for deploying Azure data platform service and big data technologies to efficiently solve Big Data processing requirements.
Overview
10
10
years of professional experience
4
4
years of post-secondary education
Work History
Lead Azure Data Engineer
Microsoft
Bangalore
01.2021 - Current
- Worked with multiple project in different domain - Philips, Victoria Dept. of Health, Swiss Re, Amadeus, Georgia Dept. of Education, McCormick.
- Worked closely with stakeholders across departments to design, build and deploy various initiatives within the data platform.
- Have experience in leading Offshore and Onshore team.
- Streamline the PoC and Deliverables with the team using best practices.
- Get challenges to fix the code in a short timeline.
- Performance and optimize the code to run within permissible time limit
- Technical Environment: PySpark, Python (Pandas), Azure Services (Databricks, Storage Account, ADF, Azure Dev Ops, GitHub, Azure Repos)
Senior Azure Data Engineer
Maersk
Bangalore
02.2019 - 01.2021
- Worked on high level design and low-level architecture design for the project
- Worked closely with stakeholders across deptartments to design, build and deploy various initiatives within the data platform
- Experience in building Ingestion pipeline and Data transformation pipeline.
- Developed common pipeline for Ingestion and processing in Azure data factory for scheduling various jobs like spark jobs, jar activities, copy activities etc
- Perform development and operations duties, sometimes requiring support during off-work hours
- Azure DevOps for CI and CD (Creating Release Pipeline and running for it for deployment)
- Technical Environment: PySpark, Python (Pandas), Azure Services (Databricks, Storage Account, ADF, Azure Sql Synapse), Azure Dev Ops, GitHub, Azure Repos
Module Azure Data Engineer
Mindtree
Bangalore
03.2018 - 02.2019
- Requirement Analysis and creating design for each integration
- Done coding in spark, Ingestion, cleansing, transformation and Aggregation of data
- Writing complex spark-sql scripts to fulfill the transformation & aggregations
- Involved in coding related to logging for application to store the logs to Data Lake
- Developed common pipeline for Ingestion and processing in Azure data factory for scheduling various jobs like spark jobs, jar activities, copy activities etc
- Azure Dataflows for processing common data
- Creating Azure Data factory V2 Arm template for deployment
- Creating Data modeling, KPI, Measures using AAS
- Technical Environment: PySpark, Python (Pandas), Azure Services (Databricks, Storage Account, ADF, AAS, Logic App, Function App, Azure SQL Synapse)
Business Technology Analyst
Deloitte USI
03.2016 - 03.2018
- Worked with major client like Walmart, Kraft Heinz and HPI for creating the big data platform.
- Creating LLD, getting requirement and updating Jira based on review from clients
- Using Spark SQL and Python, data quality checks were implemented
- Also using Spark and Python, different calculation and transformations as per the requirement were done for the dashboard
- Worked on creating DDLs and shell scripts
- Worked on creating the Oozie job and created the wrapper script for it
- Technical Environment: Spark, Python, HDFS, Hive, Sqoop, Oozie
Software Engineer
CGI
Bangalore
12.2012 - 03.2016
- Using Spark SQL and Python, data quality check was implemented
- Also using Spark and Python, different calculation and transformations as per the requirement were done for the dashboard
- Worked on creating DDLs and shell scripts
- Worked on creating the Oozie job and created the wrapper script for it
- Worked on Atscale for data modelling
- Python Scripts for unzipping files
- Scheduling the workflow through Control M
- Technical Environment: Spark, Python, HDFS, Hive, AtScale, Sqoop, Oozie
Education
Executive Data Science Degree - Computational Data Science
Indian Institute of Science
Bangalore 03.2022 - Current
Bachelor of Technology - Computer Science And Programming
APJ Abdul Kalam Technical University
Lucknow 07.2008 - 06.2012
Skills
Azure Databricks
Apache Spark
Python
Azure Synapse Analytics
Azure Data Factory
Azure DevOps
Azure Event Hub
SQL
Hadoop/Big Data Ecosystem
Data Modeling
Data Quality Engineering
Timeline
Executive Data Science Degree - Computational Data Science
Indian Institute of Science
03.2022 - Current
Lead Azure Data Engineer
Microsoft
01.2021 - Current
Senior Azure Data Engineer
Maersk
02.2019 - 01.2021
Module Azure Data Engineer
Mindtree
03.2018 - 02.2019
Business Technology Analyst
Deloitte USI
03.2016 - 03.2018
Software Engineer
CGI
12.2012 - 03.2016
Bachelor of Technology - Computer Science And Programming
APJ Abdul Kalam Technical University
07.2008 - 06.2012