Summary
Overview
Work History
Education
Skills
Websites
Certification
Timeline
Generic

Nitesh Anand

Data Engineer

Summary

Driven Data Engineer with over 6 years of experience transforming big data into actionable, meaningful insights by applying complex business logic. Expertise in building robust databases and optimizing data-intensive applications using cutting-edge tools like Snowflake, DBT, Databricks, and AWS. Proven ability to develop scalable data migration solutions and enable advanced data analytics for strategic decision-making

Overview

6
6
years of professional experience
7
7
years of post-secondary education
3
3
Certifications

Work History

Data Engineer

EPAM
02.2025 - Current
  • Ingested the 'Vector' table to Concord tables, and added a data contract to load data to different targets, such as BigQuery.
  • Enhanced data accessibility and retrieval performance by developing semantic models, creating analytical cubes from Concord entities, and implementing materialized views to support faster data access for business intelligence, and advanced analytics.
  • Monitored data pipelines for continuous data replication to different targets, like BigQuery and Placer.

Data Engineer

LumenData
11.2024 - 02.2025
  • Engineered and optimized a scalable data infrastructure, leveraging Snowflake, Fivetran, and dbt, to enhance advanced reporting and analytics capabilities.
  • Automated high-volume data ingestion from diverse sources into Snowflake using Fivetran, ensuring seamless and efficient data replication, including the handling of semi-structured JSON data.
  • Developed and executed complex data transformations with dbt, including flattening JSON data, to create clean, structured datasets that meet predefined metrics for data profiling and mapping.
  • Utilized key Snowflake features like Tasks, Streams, Clustering, and Time Travel to build robust and resilient data pipelines.

Data Engineer

Lumendata
11.2023 - 11.2024
  • Led the end-to-end migration of legacy data from on-premises SQL Server to Databricks Delta Lake using Azure Data Factory (ADF) as the orchestration tool.
  • Designed and implemented over 100 ADF pipelines for scalable and automated ETL processes, supporting structured and semi-structured data ingestion.
  • Designed and built scalable data pipelines adhering to the Databricks Medallion Architecture (Bronze, Silver, Gold layers), applying complex transformations to raw data, and storing it in optimized Delta Lake tables.
  • Managed data governance and security by utilizing Unity Catalog for centralized data access control, discovery, and auditing across the Databricks platform.
  • Developed dynamic Power BI dashboards for real-time reporting, connecting directly to transformed data in Databricks to deliver key business intelligence, and actionable insights.
  • Monitored data pipeline performance, established proactive alerting systems, and ensured seamless data flow, significantly improving the reliability, scalability, and consistency of data reporting and analytics processes.

Senior Data Engineer

Accenture
09.2022 - 11.2023
  • Worked on end-to-end development of a sales performance dashboard for a major oil and natural gas client, integrating and transforming complex raw SAP data into a unified, consistent data model within Snowflake.
  • Engineered robust ETL processes on Snowflake using SnowSQL scripts and stored procedures, applying complex business logic to derive key metrics such as revenue, profit margin, and customer retention rate.
  • Optimized Snowflake configurations and queries to achieve high performance, while implementing best practices for data storage and retrieval to maximize cost efficiency.
  • Leveraged advanced Snowflake features, including bulk loading, cloning, and Time Travel, to optimize data ingestion and processing workflows for more than 50+ tables.
  • Documented the entire data migration and transformation process, including configurations, transformations, and troubleshooting steps, ensuring maintainability, and knowledge transfer.

Data Engineer

Accenture
07.2021 - 08.2022
  • Orchestrated and successfully completed the migration of over 20 TB of data from SAP HANA to the Snowflake platform, leveraging Qlik Replicate for efficient data replication, and ensuring minimal downtime.
  • Conducted comprehensive assessments of the existing SAP HANA data warehouse, and developed detailed migration plans, including risk management strategies, to ensure data quality, integrity, and consistency.
  • Applied necessary data transformations to align source data with Snowflake's schema and architecture, ensuring optimal data structure, and seamless integration for downstream consumption.
  • Achieved significant improvements in query response time, reduced storage costs, and increased data warehouse concurrency, directly enhancing performance, scalability, and cost-efficiency for business users.

AWS Glue Developer

Tata Consultancy Services
09.2019 - 06.2021
  • Engineered and implemented an end-to-end enterprise data warehousing solution on AWS Redshift, orchestrating the migration of mainframe data for modernization and reporting.
  • Developed scalable and efficient AWS Glue ETL jobs using PySpark scripts, extracting data from diverse sources (S3, RDS, DynamoDB) and loading into Redshift clusters for analytics and reporting.
  • Optimized AWS Glue job performance by tuning parameters (e.g., concurrency, partitioning) and applying best practices (e.g., caching intermediate results, avoiding unnecessary shuffles) for maximum efficiency.
  • Orchestrated complex ETL workflows using Step Functions and event-based triggers for automated job execution.
  • Utilized AWS Glue Crawlers to populate the Data Catalog with metadata, and monitored job performance metrics to ensure seamless data flow and reliability.
  • Leveraged a broad range of AWS services, including Lambda, DMS, SQS, SNS, and Athena, to build a robust and modern data ecosystem.

Education

BE - Computer Science

Lakshmi Narain College of Technology (LNCT)
Bhopal, India
08.2015 - 06.2019

Intermediate - Science

BR College
05.2013 - 04.2015

Senior Secondary - Science

D.A.V Public School
04.2012 - 04.2013

Skills

    Snowflake

undefined

Certification

Snowflake SnowPro Core

Timeline

Data Engineer

EPAM
02.2025 - Current

Data Engineer

LumenData
11.2024 - 02.2025

Data Engineer

Lumendata
11.2023 - 11.2024

Senior Data Engineer

Accenture
09.2022 - 11.2023

Data Engineer

Accenture
07.2021 - 08.2022

AWS Glue Developer

Tata Consultancy Services
09.2019 - 06.2021

BE - Computer Science

Lakshmi Narain College of Technology (LNCT)
08.2015 - 06.2019

Intermediate - Science

BR College
05.2013 - 04.2015

Senior Secondary - Science

D.A.V Public School
04.2012 - 04.2013

Similar Profiles

CREATE PROFILE
Nitesh AnandData Engineer