Rajat Hegde
Data Engineer
Bengaluru
Summary
Adept Data Engineer with a proven track record at NewsCorp India and Infosys Ltd., specializing in ETL development and Data Pipeline Design. Demonstrated expertise in optimizing commercial data landscapes and enhancing data warehousing solutions. Excelled in collaborative problem-solving, significantly improving data-driven decision-making processes.
Overview
6
6
years of professional experience
Work History
Data Engineer
NewsCorp India
06.2022 - Current
- In this new job role in a new Company, I am Currently involved in Maintaining, Enhancing and Optimizing the Commercial Data Landscape pertaining to the vast area of Ads, Ad space and everything beyond it encompassing the different Vendor provided data spanning across multiple APIs and file servers.
- I am responsible for creating Pipelines in the existing Python based framework to fetch data from various vendor APIs and present it to various stakeholders for their Business Analysis. Helping them in Ad Campaigns, Optimizing the Ad Revenue, Prediction etc.
- Another core responsibility I have is in maintaining the Data Warehouse and Data Marts named CABLE and CDM respectively relating to Google logs and data relating to Ad Impressions, Ad clicks and everything that revolves around like Ad space bids, Revenue etc.
- The Commercial Data Area has data from multiple vendors with Google being the Core vendor and I have successfully tackled and handled many challenging scenario's pertaining to this in an efficient manner
Technology Analyst
Infosys Ltd.
03.2021 - 05.2022
- I worked on another project with the same client pertaining to data area relating to Reinsurance, Sales and Marketing Domain.
- I basically helped in creating and maintaining Data Marts relating to Clicks, Bounces and Performances measures of the Mail Campaigns (i.e both email and physical mails) and also Data Marts related to Reinsurance for the Corporate Insurance products namely 401K
- Tech and Tools used were Airflow for orchestration, inbuilt Python framework for handling execution of underlying SQLs and other scripts used in loading and transforming Data.
- I had enhanced the Python framework to send the email alerts for Pipeline execution and data validation
Senior Systems Engineer
Infosys Ltd.
01.2020 - 03.2021
- I worked with new client in Insurance domain, mainly contributed in creating and maintaining a Centralized warehouse for the Customer Data
- The Customer Insights Platform (CIP) was created in Vertica Database, and I worked from scratch to built it, it was basically pulling the Customer data spread across various Databases of DB2, SQL server, Maria DB and other into a single place and also doing the Master Data Management to the final data
- The tools and tech used was Maestro and Jenkins for orchestration and SQLs for Data Transformation and inbuilt shell framework for handling execution of the actual SQLs and other scripts.
- Also worked in Migration of Informatica workflows to Pipleines based out of actual shell scripts
Systems Engineer
Infosys Ltd
08.2018 - 01.2020
- I worked for a major client in Pharma domain mainly in Data Project related to maintaining the data warehouse built on Teradata.
- I was supporting in maintaining and managing Informatica workflows that acted as the Ingestion Pipelines to feed the data into Warehouse.
- Also building various Bteq scripts in Teradata to handle Data Quality and Data Transformation rules
Education
B.E (Bachelor of Engineering) -
The National Institute of Engineering
Mysore, India 04.2001 -
Skills
ETL development
Data Pipeline Design
Data Modeling
Data Warehousing
Python
SQL
Languages
English
Advanced (C1)
Kannada
Bilingual or Proficient (C2)
Hindi
Advanced (C1)
Timeline
Data Engineer
NewsCorp India
06.2022 - Current
Technology Analyst
Infosys Ltd.
03.2021 - 05.2022
Senior Systems Engineer
Infosys Ltd.
01.2020 - 03.2021
Systems Engineer
Infosys Ltd
08.2018 - 01.2020
B.E (Bachelor of Engineering) -
The National Institute of Engineering
04.2001 -
Similar Profiles
Nihaz M NNihaz M N
Senior Enterprise-Cloud Security Engineer at NewsCorp IndiaSenior Enterprise-Cloud Security Engineer at NewsCorp India
Elaine IroElaine Iro
Customer Support Officer at NewsCorpCustomer Support Officer at NewsCorp
Craig FlintCraig Flint
Folding Team Leader at APN/NewsCorpFolding Team Leader at APN/NewsCorp
Madhuri KonduruMadhuri Konduru
Assistant Manager at VodafoneAssistant Manager at Vodafone
Sandhya CSandhya C
Assistant Manager – People Advisory Services at Ernst and YoungAssistant Manager – People Advisory Services at Ernst and Young