Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic
Mayank Satija

Mayank Satija

Gurugram

Summary

Results-driven Data Engineer with 6 years of experience specializing in designing and implementing scalable data solutions. Skilled in Azure Data Factory and Azure Databricks for efficient data ingestion, transformation, and orchestration. Expertise in SQL, Python, and Spark for advanced data processing and analytics. Adept at developing robust ETL pipelines using , optimizing performance, and ensuring data quality. Proven ability to collaborate with stakeholders, translate business requirements into technical solutions, and drive data-driven decision-making.

Overview

6
6
years of professional experience
1
1
Certification

Work History

Senior Data Engineer

Accenture
Gurugram
04.2022 - Current
  • The project involved creating data-driven business solutions and solving data problems using a wide variety of technologies, such as Azure Databricks, Azure Datafactory, PySpark, SQL, Python, ADLS and Apache Spark.
  • Expertly utilized ADF for ingesting data from various sources, such as SQL databases, blob storage, and external file system, ensuring efficient data integration and workflow automation.
  • Conducted data transformation and processing using Azure Databricks, with extensive use of PySpark to handle large-scale datasets.
  • Implemented robust data quality checks and validation processes within Databricks to ensure data integrity and reliability.
  • Optimized ETL processes and data workflows for maximum efficiency and performance, reducing overall data processing time by leveraging parallel processing in Databricks.
  • implemented continuous integration and continuous deployment (CI/CD) pipelines using Azure DevOps, automating the build, test, and deployment processes.
  • Experience working on Data Lake specially on Delta Tables with features like Time Traveling, Change Data Capture (using Table Changes)

Programmer Analyst

Bitwise Solutions
Pune
09.2019 - 04.2022
  • Worked on migration projects involving the transition of Ab Initio graphs and Informatica PowerCenter mappings to Informatica Intelligent Cloud Services.
  • Successfully converted Informatica PowerCenter mappings, workflows, and sessions into IICS equivalents (mappings, mapping tasks), utilizing IICS's tools and features for optimal functionality.
  • Executed thorough testing and validation of migrated workflows to ensure data accuracy, completeness, and adherence to business requirements.
  • Utilized Unix file system for effective file management, handling data organization, access permissions, and automation of file operations.
  • Utilized Apache Airflow for data orchestration and developed DAGs using Python to automate and manage data workflows.
  • Leveraged Git Bash for version control and migrating configurations to higher environments involving jenkins
  • Tracked and resolved defects during code migration to the production environment, ensuring smooth deployment and addressing issues proactively

Systems Engineer

Infosys
Pune
07.2018 - 08.2019
  • Developed and optimized ETL processes using Informatica PowerCenter to efficiently extract, transform, and load data across various systems.
  • Collaborated with clients to gather and document detailed requirements, ensuring that ETL solutions met their business needs and objectives.
  • Creating schedules and jobs on the TWS scheduler for automated runs.
  • Utilized Unix file system for effective file management, handling data organization, access permissions, and automation of file operations.

Education

B.tech - Information Technology

Jaypee Institute of Information Technology
Noida
01-2018

Skills

  • Azure Databricks
  • Azure Datafactory
  • Pyspark
  • SQL
  • Spark
  • Python
  • Azure Datalake
  • Git
  • Informatica
  • Data Warehousing
  • Unix
  • Airflow

Certification

  • Azure fundamentals (AZ-900)
  • Fundamentals of Databricks Lakehouse Platform

Timeline

Senior Data Engineer

Accenture
04.2022 - Current

Programmer Analyst

Bitwise Solutions
09.2019 - 04.2022

Systems Engineer

Infosys
07.2018 - 08.2019

B.tech - Information Technology

Jaypee Institute of Information Technology

Similar Profiles

CREATE PROFILE
Mayank Satija