Summary
Overview
Work History
Education
Skills
Certification
Timeline
Hobbies
Generic

Akhil Bajpai

Senior Data Engineer
Bengaluru

Summary

Data engineer with over 6 years of experience at both product & service based organizations possessing end-to-end understanding on the entire data workflow across different systems. Experienced in handling customer, sales, marketing and financial data thereby facilitating data based strategic decision-making.

Overview

5
5
years of professional experience
8
8
years of post-secondary education
8
8
Certificates
2
2
Languages

Work History

Senior Data Engineer

Thoughtspot
Bengaluru
08.2023 - Current
  • Collaborated with cross-functional finance, sales, marketing & security teams on their data requirements.
  • Facilitated leadership with customer life cycle, marketing & sales analytics and financials aiding them in strategic decision-making.
  • Leveraged Snowflake's Snowpark for forecasting sales & recurring revenue.
  • Integrated API from Workday, Okta, Service Now, Tenable, Proofpoint, Security Scoreboard, Skill Jar, Adaptive Insights as data source.
  • Reengineered existing ETL workflows to improve performance by ~25%.
  • Utilized Matillion and Fivetran with DBT for data ingestion and transformation.
  • Migrated Service Now, Okta, Workday data pipelines from fivetran to databricks.
  • Developed databricks pipelines using pyspark to integrate API of Tenable, Proofpoint, Security Scoreboard, Skill Jar, Adaptive Insights as data source.
  • Leveraged ThoughtSpot cloud for AI based analytics and visualization.

Senior Data Engineer

Kipi.bi
Bengaluru
01.2022 - 08.2023
  • Handled manufacturing and finance domain data.
  • Experience in AWS cloud, Matillion ELT, Snowflake data warehouse, SQL DBM, Tableau, Power BI, SQL Server, and Python programming.
  • Led end-to-end project lifecycle from business requirement gathering to catering dashboards to leadership.
  • Modelled data using Star, Snowflake, and Data Vault techniques and documenting into data mapping tables.
  • Experience in AWS cloud services: Lambda, SQS, SNS, SES, EventBridge, S3, IAM, Lex, CodeCommit, and SageMaker.
  • Skilled in Matillion ELT for data ingestion, transformation and validation using Matillion ELT.
  • Implemented metadata-driven data loading in Matillion ELT and ensured DataOps implementation with data governance.
  • Performance optimization of ETL pipelines and cost optimization on snowflake data warehouse.
  • Processing batch, continuous, and streaming data using Kafka and Spark.
  • Designed security features including RBAC, network policies, row-level security, and column-level security for handling sensitive PII data.
  • Data cataloging and lineage using Snowboard.
  • Analyzed reports in Tableau & Power BI, implemented RLS security, and designed wireframes and KPI dashboards.
  • Familiar with big data technologies such as Hadoop, Kafka, and Spark, and exposure to Microsoft Power BI for data analytics and visualization.
  • Recognized with multiple Key Player Award and Limelight Award.

Data Engineer

HPE : Hewlett Packard Enterprise R&D
Bengaluru
08.2020 - 01.2022
  • POC for migrating on-premises data to Snowflake cloud warehouse.
  • Developed data pipelines and conducted unit testing using Matillion ETL.
  • Created stored procedures, UDFs, and CTEs for data processing in Snowflake.
  • Technologies used SQL Server, Snowflake cloud data warehouse , Matillion ETL, Code Commit, AWS, MS Excel.

Software Developer

HPE : Hewlett Packard Enterprise R&D
Bengaluru
07.2019 - 08.2020
  • BIOS and BMC firmware development for HPE servers, including PLDM support and RDE Device Enablement.
  • Proficient in debugging and bug fixing complex issues.
  • Experienced in Static Code Analysis for code quality and reliability.
  • Skilled in end-to-end development of web-based dashboards using Python, Flask, JavaScript, MongoDB, Docker, and Jenkins.
  • Recognized for courage and commitment to results, earning awards for bold moves and dedication to excellence.

Education

Bachelor of Technology - Computer Science & Engineering

SRM Institute Of Science & Technology ( Deemed University)
Jhansi
08.2011 - 05.2019

Skills

Data Modeling

Certification

SnowPro Advanced : Data Engineer CertiZed, Snow-ake

Timeline

Senior Data Engineer

Thoughtspot
08.2023 - Current

Senior Data Engineer

Kipi.bi
01.2022 - 08.2023

Data Engineer

HPE : Hewlett Packard Enterprise R&D
08.2020 - 01.2022

Software Developer

HPE : Hewlett Packard Enterprise R&D
07.2019 - 08.2020

Bachelor of Technology - Computer Science & Engineering

SRM Institute Of Science & Technology ( Deemed University)
08.2011 - 05.2019

Hobbies

  • Cooking.
  • Table Tennis.

Similar Profiles

CREATE PROFILE
Akhil BajpaiSenior Data Engineer