Madhuri Sony
Mumbai
Summary
- Professional, result-oriented, skilled Sr. Data Engineer with 7+ years of experience in building Data Integration, Data Processing applications.
- In-depth knowledge and expertise on Snowflake, Databricks, Hadoop, Spark and ETL tools.
- Key involvement in automating end-to end process on-prem to Cloud data migration for multiple clients using Snowflake, AWS, Airflow & Azure Databricks.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
IBM (Client : Medtronic)
11.2021 - Current
- Developed and implemented ETL/ELT pipelines, integrating data from various sources into Snowflake platform.
- Implemented role-based access controls and data encryption measures, ensuring the security and protection of sensitive data within the Snowflake platform.
- Designed and Implemented a data migration strategy, successfully migrating 10 terabytes of data from an on-premise database to the Snowflake cloud data platform, resulting in a 50% reduction in data retrieval time and improved data accessibility for the organization.
- Optimized SQL queries and adjusted resource allocation, improving query performance by 30%
- Created data models and implemented data governance practices, ensuring data consistency and quality.
Senior Informatica Big Data Developer
Accenture ( Client : Takeda)
01.2021 - 11.2021
- Implemented Informatica BDM mappings and workflows for extracting data from Legacy DWH.
- Developed mappings Slowly Changing Dimensions for SCD Type 1,Type 2 and Type 6.
- Implemented reusable mappings & sessions for Operational Audit Process
- Created mappings to keep historical data and load control for ETL extract.
- Prepared technical specifications and functional.
- Worked with Data Modelers and Business users to gather business requirements.
- Worked on Unit Testing, Quality Checks, Production Deployment
- Worked on Unix scripting and SQL queries.
Informatica Big Data Engineer
TCS
09.2016 - 01.2021
- Designed and Implemented ETL Big Data Ingestion applications with extraction of data from various source systems such as Salesforce, JSON, REST API, Flat files, SQL Server, etc.
- Implemented ETL solutions to ingest data into S3 buckets using AWS EMR and Informatica for semi-structured sources.
- Extensively worked on Big Data usecases to streamline ingestion in Cloudera Data Lake using Informatica BDM 10.4.0 tool.
- Experience in AWS services like EC2, EMR, S3 buckets and their roles and policies, Cloud Watch, etc.
- Installed, configured & upgraded Informatica BDM v10.4.0.2 platform.
- Integrated Stonebranch with Informatica and implemented Event-based workload automation solution for scheduling of Informatica applications using Stonebranch.
Education
Bachelor of Engineering - ECE
06.2016
Skills
- Snowflake
- DBT
- Azure Databricks
- Hadoop, Hive, HDFS , Spark, Cloudera Data Lake
- AWS Cloud (EC2, IAM, EMR, S3, CloudWatch, Lambda, RDS, Airflow)
- Informatica BDM
- Informatica Powercenter
- Data Quality
- Stonebranch
- Agile Methodology
- Erwin Data Modelling
- Airflow
Accomplishments
- Top Contributor at IBM Organization level
- Star of the Month for end-to-end delivery and integration of Stonebranch service with Informatica BDM
- On the Spot Award for my-prompt and on-time solution delivery.
- Appreciation mails from clients for outstanding performance and high quality deliverables.
- Received Service and Commitment Award from TCS.
- Best Team Award for demonstrating excellent teamwork and successful project Go Live.
Certification
AWS Certified Cloud Practitioner
Languages
English
Bilingual or Proficient (C2)
Hindi
Bilingual or Proficient (C2)
Timeline
Senior Data Engineer - IBM (Client : Medtronic)
11.2021 - Current
Senior Informatica Big Data Developer - Accenture ( Client : Takeda)
01.2021 - 11.2021
Informatica Big Data Engineer - TCS
09.2016 - 01.2021
Pillai College of Engineering - Bachelor of Engineering, ECE
Similar Profiles
Anil PatidarAnil Patidar
Test Program Manager at IBM India, Client Elevance HealthTest Program Manager at IBM India, Client Elevance Health
Amrendra KumarAmrendra Kumar
Engineer Premium at IBM(Client- American Express)Engineer Premium at IBM(Client- American Express)
Daniela SoleraDaniela Solera
Senior Talent Acquisition Coordination at IBM - Client A.P. Moller - MaerskSenior Talent Acquisition Coordination at IBM - Client A.P. Moller - Maersk
Aditya ApteAditya Apte
Product Manager at ProgIST Solutions LtdProduct Manager at ProgIST Solutions Ltd
Tamanna AgarwalTamanna Agarwal
Consultant Specialist at HSBCConsultant Specialist at HSBC