Suchi Prasad
Mumbai
Summary
Seasoned Data Engineer with extensive experience in Data Analytics and Engineering, orchestrating team dynamics.
Overview
14
14
years of professional experience
Work History
Assistant Manager - Data Engineering
General Mills
Mumbai
11.2021 - Current
- Lead the Data Engineering team within the NAR IDS POD.
- Own and ensure timely delivery of all Data Engineering deliverables.
- Collaborate closely with the DFT team and analysts to design and build robust data pipelines.
- Drive adoption of new technologies and DSE standards across the POD, including cost optimization, dbt, Monte Carlo, STAMP, and Copilot.
- Mentor and support team members to foster growth and high performance.
- Partner with architects and team members to streamline and improve engineering processes.
- Represent the Data Engineering team in NAR IDS Leadership Meetings.
Lead Big Data Systems
DCB Bank
02.2019 - 10.2021
- Effectively created solutions to solve business problem
- Conceptualized, developed and deployed Dedupe system for on-boarding new Bank Customers using Spark, Livy, Python, Hadoop
- Maintenance and Data Integrity of Data Lake
- Overseen upgradation of Cloudera CDH 5.7 to CDH 6.2
- Development and Deployment of Customer 360 using Hadoop Stack
- Automation of regulatory reports using Hadoop Stack and Pentaho (ETL)
- Managing Team of 10+ members
- Maintenance Hadoop Cluster
- Effectively collaborated with Stakeholder on deliverable
- Capture Business Requirement Document and Process flow, and take Audit, Compliance and Security Sign-off before Production Movement
Big Data Developer
L&T Infotech
08.2016 - 01.2019
- Developed code for migration of Unstructured Data to HBASE using Spark
- Developed sqoop jobs for Migrating Structured Data
- Shell Scripting to prepare data before migration
- Develop File streaming
- Device strategy for Incremental and One Time Data ingestion
Data Engineer
Tata Consultancy Services
10.2011 - 07.2016
- Understanding the requirement of the client
- Develop sqoop jobs for data ingestion from RDBMS to Hive
- Work on adhoc analysis as per requirement
Education
B.Tech - Computer Science
SRM University
08.2011
Skills
- Big query
- Airflow
- Google Cloud
- DBT
- Monte Carlo
- Team Management
- Microsoft Co-pilot
- Data Pipeline
- Data Analysis
- Team leadership
- Stakeholder collaboration
- Agile methodology
- Spark Streaming
- Kafka
- PySpark
- Hadoop
- Spark
- Hive
- HBASE
- Sqoop
- Cloudera CDH Upgradation
Timeline
Assistant Manager - Data Engineering
General Mills
11.2021 - Current
Lead Big Data Systems
DCB Bank
02.2019 - 10.2021
Big Data Developer
L&T Infotech
08.2016 - 01.2019
Data Engineer
Tata Consultancy Services
10.2011 - 07.2016
B.Tech - Computer Science
SRM University