Summary
Overview
Work History
Education
Skills
Certification
Languages
Timeline
Generic

Spandan Kumar Das

Banglore

Summary

Responsible Data Engineer, passionate about delivering outstanding quality and service. Having 8+ years of experience in industry with history of recognition for performance.

Overview

8
8
years of professional experience
1
1
Certification

Work History

Software Engineer

NatWest Group
10.2021 - 02.2024
  • Developing the Pyspark Script to write different business Logic.
  • Developing the Airflow DAG to run the Spark script and Building the Dependency and Scheduling the job as per timing.
  • Developing the Unix Shell script to implement couple of Requirement By the Business.
  • Taking care the EMR and Airflow Version Upgrade so that Many upgraded Feature will add for the optimising the running time.
  • Giving the Technical Solutions and providing the RCA for the different data issue happening in Prod.

Senior Software Engineer

CGI
12.2020 - 10.2021
  • Basically This Project was to Process the Retail Customer Data of US based Bank.
  • Developed the solution to Provide the data for different LOB and Developed the HQL scripts to create the Hive External Table.
  • Developed the Pyspark script to doing the the transformation of the business logic and Taking Care of Application Optimisation.
  • Triggered the jobs Using Control-M scheduler.

Technology Analyst

Infosys
10.2015 - 12.2020
  • This Project was HSBC cognitive analysis.
  • Basically Money Laundering and Financial crime happens in every of Geo Specific country.so We provided the Data to Business to identify the fraudulent transaction.
  • Developed the DDL and DML scripts using HQL.
  • Developed the Shell script to call the HQL scripts and load the Target Table.
  • Developed a DQ checks automated Script in HQL to check the Data Post Loading in Target Table.

Education

BTech - Electrical & Electronics Engineering

SOA University
Bhubaneswar
2015

Skills

  • ETL development
  • Data warehouse design
  • Python
  • SQL
  • Data analytics
  • PySpark
  • Hadoop
  • AWS
  • Hive
  • Airflow
  • Shell Scripting

Certification

AWS certified Solution Architect-Associate level (validation No- VKHGKMS1Q2EEQ354)

Languages

English
Proficient
C2

Timeline

Software Engineer

NatWest Group
10.2021 - 02.2024

Senior Software Engineer

CGI
12.2020 - 10.2021

Technology Analyst

Infosys
10.2015 - 12.2020

BTech - Electrical & Electronics Engineering

SOA University

Similar Profiles

CREATE PROFILE
Spandan Kumar Das