Ranjeet Yadav
Team Lead
Pune City East
Summary
Highly skilled IT professional with over 7 years of hands-on experience in big data technologies, including Hadoop, Spark, and Google Cloud. Expertise in designing, implementing,data modeling, and managing large-scale data processing solutions
Overview
8
8
years of professional experience
7
7
years of post-secondary education
Work History
Team Lead
Datametica Solutions PVT Limited
pune
01.2023 - Current
- Understanding the business requirement, preparing the design and Data Modelling for effective system development.
- Implement code in PySpark to read data from hive, Flast files and load them to Hive external Tables.
- Created DataModel on which which multiple reports were reading data from same table.
- Worked on improving Performance and optimization of Pyspark jobs and Hive Queries.
- Design Partition and Clustering for Hive Tables.
- Developed analytical use cases in Pyspark.
- Fixing Bugs/Production issues .
- Mentor and Lead team of 10 Associates.
- Held regular meetings to ensure alignment with workflow and to ensure team members were on track to meet deadlines.
- Evaluated employee skills and knowledge regularly, training, and mentoring individuals with lagging skills.
- Worked different stations to provide optimal coverage and meet production goals.
Senior Engineer
Datametica Solutions PVT Limited
Pune
01.2021 - 12.2022
- DataStage and DB2 Migration to GCP.
- Migrated petabytes of data from On Premise to GCP.
- Converted the Datastage scripts to BQ compatible and
- Load data from file and DB2 to GCP using SQOOP.
- Created Airflow DAG using python to populate the tables in BigQuery.
- Working on to fix bugs(data issues) received from clients/Onsite colleagues on priority.
- Involved Deployment activity on production.
- Troubleshooting the bugs that were received.
- Co-coordinate between the Business and the Off-shore teams
Engineer II
Datametica Solutions PVT Limited
Pune
01.2019 - 01.2021
- Teradata and Infoworks Migration to GCP.
- Migrated petabytes of data from On Premise to GCP.
- Converted the Teradata scripts to BQ compatible
- Load data from Teradata and Oracle to GCP using Infoworks tool.
- Created Airflow DAG using python to populate the tables in BigQuery.
- Working on to fix bugs received from clients/Onsite colleagues on priority.
- Involved Deployment activity on production.
System Engineer
DXC Technology
Bengaluru
01.2016 - 01.2019
- Administering User and functional accounts across multiple systems and application
- Windows file share administration
- Creating and Provisioning of Security Groups, Distribution Groups, home directory and shared folder
- Creating And Provisioning of Shared Mailbox and Room Mailbox in O365.
Education
B.Tech - Computer Science Engineering
Guru Nanak Institute of Technology
Kolkata 07.2011 - 07.2015
XII - Science
St Sebastian's School
Kolkata 04.2008 - 03.2010
X -
St. Sebastian's School
Kolkata 03.2007 - 03.2008
Skills
SQL
Pyspark
Bash Scripting
Python
GCP, BigQuery, Hive
Airflow, Oozie
Data Modeling
Timeline
Team Lead
Datametica Solutions PVT Limited
01.2023 - Current
Senior Engineer
Datametica Solutions PVT Limited
01.2021 - 12.2022
Engineer II
Datametica Solutions PVT Limited
01.2019 - 01.2021
System Engineer
DXC Technology
01.2016 - 01.2019
B.Tech - Computer Science Engineering
Guru Nanak Institute of Technology
07.2011 - 07.2015
XII - Science
St Sebastian's School
04.2008 - 03.2010
X -
St. Sebastian's School
03.2007 - 03.2008