Experienced Lead Data Engineer skilled in data pipeline design, spark development, and big data processing, with a proven track record of leveraging Python and Scala programming to uncover customer insights. Adept at developing and implementing ETL processes to drive data-driven decision-making. Eager to contribute expertise in data engineering to support innovative projects and enhance team performance.
Overview
20
20
years of professional experience
1
1
Certification
Work History
Lead Data Engineer
Ernst & Young
12.2020 - Current
Customized Offerings (4 Ps) based on Customer Demographics
Post Sales & Service Feedback through Voice AI
Enquiry Management through App
Digital Billing Dashboard
Automated Process Adherence (QLQD / NPS / CI guidelines / Dealer Hygiene) using Image Processing
Experience in developing spark applications using spark SQL in databricks for data extraction, transformation and aggregation from multiple file formats for analysing and transforming the data to uncover insights in to the customer usage patterns.
Building the pipeline to copy the data from source to destination in Azure Data Factory
Created Stored procedures and scheduled it using the ADF.
Worked on creating dependency for activities in Azure Data Factory.
Ernst & Young is a multinational professional services firm providing audit, tax, consulting, and advisory services.
Lead Data Scientist
Cognizant Technology Solutions, India Pvt. Ltd.
Bangalore
05.2020 - 06.2020
The objective of this case study is to web scrap the product reviews, employee reviews, job opening details from different portals (LinkedIn, Indeed, Consumer Affair, Glass Door) for the company MassMutual and its competitor.
All the data we have retrieved is between the data range 2018-2020.
Techniques used: For collecting we have Used Python selenium to retrieve the data from the portals. Applied Stemming and Lemmatization for Text Normalization and prepare the words for further processing. Later we have identified the most discussed topics for each company by applying topic modelling LDA method.
Cognizant Technology Solutions is a multinational technology company that provides IT services, including digital, technology, consulting, and operations services.
Data Scientist
Cognizant Technology Solutions, India Pvt. Ltd.
Bangalore
07.2019 - 05.2020
For a given OBD (onboard diagnostic data) submission from fleet providers, provide insight as a service for insurers on 2 dimensions: Risk assessment with new dimensions for insurers and Safety intervention suggestion for fleet providers which will help to reduce their risk exposure and thereby insurance cost.
Cognizant Technology Solutions is a multinational technology company that provides IT services, including digital, technology, consulting, and operations services.
Data Scientist
Cognizant Technology Solutions, India Pvt. Ltd.
Bangalore
03.2019 - 06.2019
Chubb wants to implement text mining underwriting audit solution, to detect account level violations for CI Property, CI Liability (package), CI Auto and CI Liability (umbrella). The text mining solution is expected to provide complete audit coverage for all policies, to identify account level violations.
Cognizant Technology Solutions is a multinational technology company that provides IT services, including digital, technology, consulting, and operations services.
Data Scientist
Cognizant Technology Solutions, India Pvt. Ltd.
Bangalore
12.2018 - 02.2019
To build an AI based Virtual assistant for Improve TAT for ECOS related functional questions.
Cognizant Technology Solutions is a multinational technology company that provides IT services, including digital, technology, consulting, and operations services.
Data Scientist
Cognizant Technology Solutions, India Pvt. Ltd.
Bangalore
10.2018 - 12.2018
Generate relevant targeted offer driven by Customer Demography, Spend Pattern & Customer Location for FAB Credit Card customers who are FAB Mobile App users.
Cognizant Technology Solutions is a multinational technology company that provides IT services, including digital, technology, consulting, and operations services.
Informatica Lead
Cognizant Technology Solutions, India Pvt. Ltd.
Bangalore
03.2015 - 10.2018
Involved in developing the mapping, session, Work let, Workflow, shell script, PLSQL procedure from scratch for the entire project.
Developed 100 mappings to feed the insurance information (life, home, motor) which is in the form of flat file to the target database.
Mentoring the new joiners both technically and domain knowledge.
Cognizant Technology Solutions is a multinational technology company that provides IT services, including digital, technology, consulting, and operations services.
Informatica Lead
Cognizant Technology Solutions, India Pvt. Ltd.
Bangalore
06.2014 - 03.2015
Prepared the Technical design document based on the AGP CAP facets mapping document.
Developed a new informatica mapping to load the AGP CAP data from the file to the LZ table.
Developed new BTEQ scripts to pull the AGP CAP data from the LZ table to the stage table.
Cognizant Technology Solutions is a multinational technology company that provides IT services, including digital, technology, consulting, and operations services.
Informatica Lead
Cognizant Technology Solutions, India Pvt. Ltd.
Bangalore
11.2013 - 10.2014
Responsible for Requirement Gathering Analysis and End user Meetings.
Responsible for Business Requirement Documents BRD's and converting Functional Requirements into Technical Specifications.
Responsible for mentoring Developers and Code Review of Mappings developed by other developers.
Cognizant Technology Solutions is a multinational technology company that provides IT services, including digital, technology, consulting, and operations services.
Informatica Lead
UST Global
04.2006 - 11.2010
Effectively made use of Table Functions, Indexes, Table Partitioning, Collections, Analytical functions, Materialized Views, Query Re-Write and Transportable table spaces.
Strong experience in Data warehouse concepts, ETL.
Good knowledge on logical and physical Data Modelling using normalizing Techniques.
UST Global is a digital transformation solutions company that provides IT services and solutions.
Executive Assistant Business Partner– Senior Specialist at Intuit India – Product Development Centre Pvt. Ltd.Executive Assistant Business Partner– Senior Specialist at Intuit India – Product Development Centre Pvt. Ltd.