Akhil Bajpai
Senior Data Engineer
Bengaluru
Summary
Data engineer with over 6 years of experience at both product & service based organizations possessing end-to-end understanding on the entire data workflow across different systems. Experienced in handling customer, sales, marketing and financial data thereby facilitating data based strategic decision-making.
Overview
5
5
years of professional experience
8
8
years of post-secondary education
8
8
Certificates
2
2
Languages
Work History
Senior Data Engineer
Thoughtspot
Bengaluru
08.2023 - Current
- Collaborated with cross-functional finance, sales, marketing & security teams on their data requirements.
- Facilitated leadership with customer life cycle, marketing & sales analytics and financials aiding them in strategic decision-making.
- Leveraged Snowflake's Snowpark for forecasting sales & recurring revenue.
- Integrated API from Workday, Okta, Service Now, Tenable, Proofpoint, Security Scoreboard, Skill Jar, Adaptive Insights as data source.
- Reengineered existing ETL workflows to improve performance by ~25%.
- Utilized Matillion and Fivetran with DBT for data ingestion and transformation.
- Migrated Service Now, Okta, Workday data pipelines from fivetran to databricks.
- Developed databricks pipelines using pyspark to integrate API of Tenable, Proofpoint, Security Scoreboard, Skill Jar, Adaptive Insights as data source.
- Leveraged ThoughtSpot cloud for AI based analytics and visualization.
Senior Data Engineer
Kipi.bi
Bengaluru
01.2022 - 08.2023
- Handled manufacturing and finance domain data.
- Experience in AWS cloud, Matillion ELT, Snowflake data warehouse, SQL DBM, Tableau, Power BI, SQL Server, and Python programming.
- Led end-to-end project lifecycle from business requirement gathering to catering dashboards to leadership.
- Modelled data using Star, Snowflake, and Data Vault techniques and documenting into data mapping tables.
- Experience in AWS cloud services: Lambda, SQS, SNS, SES, EventBridge, S3, IAM, Lex, CodeCommit, and SageMaker.
- Skilled in Matillion ELT for data ingestion, transformation and validation using Matillion ELT.
- Implemented metadata-driven data loading in Matillion ELT and ensured DataOps implementation with data governance.
- Performance optimization of ETL pipelines and cost optimization on snowflake data warehouse.
- Processing batch, continuous, and streaming data using Kafka and Spark.
- Designed security features including RBAC, network policies, row-level security, and column-level security for handling sensitive PII data.
- Data cataloging and lineage using Snowboard.
- Analyzed reports in Tableau & Power BI, implemented RLS security, and designed wireframes and KPI dashboards.
- Familiar with big data technologies such as Hadoop, Kafka, and Spark, and exposure to Microsoft Power BI for data analytics and visualization.
- Recognized with multiple Key Player Award and Limelight Award.
Data Engineer
HPE : Hewlett Packard Enterprise R&D
Bengaluru
08.2020 - 01.2022
- POC for migrating on-premises data to Snowflake cloud warehouse.
- Developed data pipelines and conducted unit testing using Matillion ETL.
- Created stored procedures, UDFs, and CTEs for data processing in Snowflake.
- Technologies used SQL Server, Snowflake cloud data warehouse , Matillion ETL, Code Commit, AWS, MS Excel.
Software Developer
HPE : Hewlett Packard Enterprise R&D
Bengaluru
07.2019 - 08.2020
- BIOS and BMC firmware development for HPE servers, including PLDM support and RDE Device Enablement.
- Proficient in debugging and bug fixing complex issues.
- Experienced in Static Code Analysis for code quality and reliability.
- Skilled in end-to-end development of web-based dashboards using Python, Flask, JavaScript, MongoDB, Docker, and Jenkins.
- Recognized for courage and commitment to results, earning awards for bold moves and dedication to excellence.
Education
Bachelor of Technology - Computer Science & Engineering
SRM Institute Of Science & Technology ( Deemed University)
Jhansi 08.2011 - 05.2019
Skills
Data Modeling
Data Vault Modelling
Sql DBM
SQL
MS Excel
AWS
Matillion ELT
Fivetran
DBT
Metadata driven pipeline
Databricks
Snowflake
Tableau
Microsoft Power BI
Pyspark
Python
GitJub
Certification
SnowPro Advanced : Data Engineer CertiZed, Snow-ake
Timeline
Senior Data Engineer
Thoughtspot
08.2023 - Current
Senior Data Engineer
Kipi.bi
01.2022 - 08.2023
Data Engineer
HPE : Hewlett Packard Enterprise R&D
08.2020 - 01.2022
Software Developer
HPE : Hewlett Packard Enterprise R&D
07.2019 - 08.2020
Bachelor of Technology - Computer Science & Engineering
SRM Institute Of Science & Technology ( Deemed University)
08.2011 - 05.2019
Hobbies
- Cooking.
- Table Tennis.