Highly skilled IT professional with over 7 years of hands-on experience in big data technologies, including Hadoop, Spark, and Google Cloud. Expertise in designing, implementing,data modeling, and managing large-scale data processing solutions
Overview
8
8
years of professional experience
7
7
years of post-secondary education
Work History
Team Lead
Datametica Solutions PVT Limited
pune
01.2023 - Current
Understanding the business requirement, preparing the design and Data Modelling for effective system development.
Implement code in PySpark to read data from hive, Flast files and load them to Hive external Tables.
Created DataModel on which which multiple reports were reading data from same table.
Worked on improving Performance and optimization of Pyspark jobs and Hive Queries.
Design Partition and Clustering for Hive Tables.
Developed analytical use cases in Pyspark.
Fixing Bugs/Production issues .
Mentor and Lead team of 10 Associates.
Held regular meetings to ensure alignment with workflow and to ensure team members were on track to meet deadlines.
Evaluated employee skills and knowledge regularly, training, and mentoring individuals with lagging skills.
Worked different stations to provide optimal coverage and meet production goals.
Senior Engineer
Datametica Solutions PVT Limited
Pune
01.2021 - 12.2022
DataStage and DB2 Migration to GCP.
Migrated petabytes of data from On Premise to GCP.
Converted the Datastage scripts to BQ compatible and
Load data from file and DB2 to GCP using SQOOP.
Created Airflow DAG using python to populate the tables in BigQuery.
Working on to fix bugs(data issues) received from clients/Onsite colleagues on priority.
Involved Deployment activity on production.
Troubleshooting the bugs that were received.
Co-coordinate between the Business and the Off-shore teams
Engineer II
Datametica Solutions PVT Limited
Pune
01.2019 - 01.2021
Teradata and Infoworks Migration to GCP.
Migrated petabytes of data from On Premise to GCP.
Converted the Teradata scripts to BQ compatible
Load data from Teradata and Oracle to GCP using Infoworks tool.
Created Airflow DAG using python to populate the tables in BigQuery.
Working on to fix bugs received from clients/Onsite colleagues on priority.
Involved Deployment activity on production.
System Engineer
DXC Technology
Bengaluru
01.2016 - 01.2019
Administering User and functional accounts across multiple systems and application
Windows file share administration
Creating and Provisioning of Security Groups, Distribution Groups, home directory and shared folder
Creating And Provisioning of Shared Mailbox and Room Mailbox in O365.
Drug Safety Associate/ SME at Cognizant technology solutions India Pvt . LtdDrug Safety Associate/ SME at Cognizant technology solutions India Pvt . Ltd