Summary
Overview
Work History
Education
Skills
Websites
Certification
Accomplishments
Languages
Affiliations
Timeline
Generic
Karthik P

Karthik P

Bangalore

Summary

Committed job seeker skilled in meeting company needs with consistent and organized practices. Proficient in working under pressure and adapting to new challenges to enhance the organizational brand. Experienced in building scalable data pipelines using Azure services like Azure Databricks, PySpark, Azure Data Factory, ADLS Gen2, Azure SQL database, and Azure DevOps. Strong knowledge of ETL tools, data modeling, and data warehousing concepts. Skilled in deploying solutions to production environments and migrating data from legacy databases using cloud architecture principles. Proficient in programming languages such as PySpark, SQL, and Python.

Overview

7
7
years of professional experience
1
1
Certification

Work History

Data Engineering Senior Analyst

Accenture
Bangalore
11.2022 - Current
  • Worked in various capacities as a data migration engineer on an Azure data engineering project. Data factory was used for data ingestion and orchestration from multiple data sources, and Azure Databricks with PySpark was used for data transformation and cleansing, with the final endpoint being Azure Databricks Delta Tables.
  • I have worked with various databases like Microsoft SQL Server and Oracle Database for data ingestion, with some decent experience in data modeling.
  • Ingested different types of source files like CSV, JSON, XML, parquet, etc. Into Azure Data Lake Gen2, organizing and segregating them into different layers after necessary transformation.
  • Analyzed and organized extracted raw data coming from flat files and various databases using ADF to generate enriched and curated data for business transformation with Azure Databricks, eventually to be stored in Azure data lake as delta tables. Implemented both incremental delta load logic on a daily basis and quarterly full load logic for BI reports generation, with curated layer delta table on data lake being source of truth for multiple KPI reports.

Senior Advisor

Concentrix
Bangalore
12.2021 - 05.2022
  • Provide support for running pipelines in ADF.
  • Prepare change documents and perform changes on the Production environment.
  • Respond to client-related queries and execute them in the production environment through Microsoft Azure.
  • Carrying out the unit testing in different lower/upper environments for the complete data pipelines, notebooks, and collaborating with client developers, QA team, third-party service providers, and stakeholders to ensure successful development and delivery.

Senior Analyst

HCL Technologies
Bangalore
06.2019 - 01.2021
  • Worked in various capacities as a data migration engineer on an Azure data engineering project. Wandisco was used for data ingestion from Azure Synapse Analytics, and PySpark was used for data transformation and cleansing. The data was then stored in ADLS Gen2 for downstream use.
  • Worked on creating Notebooks and Pipelines in Azure Synapse Analytics to transform ORC files to Parquet.
  • Improved Databricks notebook execution time using various optimization techniques.
  • Understanding business requirements and transforming data as per requirement.
  • Monitoring and testing data pipelines and Databricks notebooks in Azure Synapse Analytics.
  • Using Azure DevOps CI/CD pipeline to move codes/changes to higher environments.
  • Coordinating with L3 Support team to promote the codes/changes to Production environment.

Technical Support Associate 2

Convergys
Bangalore
04.2017 - 11.2018
  • Provide hardware, software, and network problem diagnosis/resolution via telephone and chat for Microsoft customers.
  • Create an incident with Action, Blocker, and Solution using the ASD tool.

Education

B.E - Instrumentation Technology

JSSATE Bangalore
08.2016

Skills

  • Python
  • PySpark
  • SQL and Databases
  • Azure Synapse Analytics
  • Azure Data Factory
  • Azure SQL Queries
  • Azure Databricks
  • Azure DevOps
  • Data Analysis
  • Data Modeling
  • Documentation And Reporting
  • Verbal and Written Communication

Websites

Certification

  • Azure Data Fundamentals
  • Azure Data Engineer Associate
  • Databricks Data Engineering Associate

Accomplishments

  • Awarded Superstar of the month twice.
  • Awarded with Best Performer.

Languages

Tamil
First Language
English
Proficient (C2)
C2
Kannada
Proficient (C2)
C2
Telugu
Intermediate (B1)
B1
Hindi
Intermediate (B1)
B1

Affiliations

  • Gaming
  • Workout
  • Travelling
  • Teaching

Timeline

Data Engineering Senior Analyst

Accenture
11.2022 - Current

Senior Advisor

Concentrix
12.2021 - 05.2022

Senior Analyst

HCL Technologies
06.2019 - 01.2021

Technical Support Associate 2

Convergys
04.2017 - 11.2018

B.E - Instrumentation Technology

JSSATE Bangalore

Similar Profiles

CREATE PROFILE
Karthik P