Summary
Overview
Work History
Education
Skills
Projects
Languages
Timeline
Generic

Sai Swaroop

Hyderabad

Summary

Results-driven Azure Data Engineer with proven expertise at Atos Eviden, specializing in ETL processes and data governance. Successfully built ingestion pipelines using Azure Data Factory and optimized performance with Pyspark. Adept at leveraging SQL for data manipulation, demonstrating strong analytical skills and a commitment to data integrity.

Overview

9
9
years of professional experience

Work History

Azure Data Engineer

Atos Eviden
03.2021 - 12.2024
  • Worked as an Azure Data Engineer at Atos Eviden, Bangalore.
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity, and verifying pipeline stability.

• Built ingestion pipelines using Azure Data Factory and scheduled using the same.

• Used Azure Databricks to perform the transformations on the data.

• Used Unity Catalog for the data governance.

• Used PySpark intensively for the performance optimization.

• Used Python to create and modify trigger scripts.

• Used SQL for data manipulation and to build databases.

• Used ADLS for data storage.

• Worked intensively with Delta tables.

Data Engineer

KARTEL Technosoft Pvt Ltd
01.2016 - 01.2021
  • Company Overview: Worked as Data Engineer in a MNC through KARTEL Technosoft Pvt Ltd, Bangalore


Education

Bachelor of Computer Degree -

William Carey University
Meghalaya

Board of intermediate education -

Board of intermediate education
AP

SSC -

Board of Secondary Education
AP

Skills

  • Azure Data Factory
  • Azure Data Bricks
  • Spark(Python)
  • SQL
  • Python
  • Hadoop
  • Hive
  • Oozie
  • Unity Catalog
  • ETL
  • Shell Scripting

Projects

 Manulife - Data Ingestion, Transformations and enhancements

I was responsible for ingesting data from global financial institutions using Azure Cloud Services, ensuring seamless integration of various financial data sources. My role involved curating this data to meet business requirements, focusing on risk management within the BFSI (Banking, Financial Services, and Insurance) domain. The project aimed to streamline the management of financial data, improve data quality, and enhance the accuracy of risk analysis models for business-critical applications.

 SunTrust Bank, 04/01/18 - 02/28/21, PySpark, Python, Hive, Shell Scripting, Impala, TWS, Oozie, Created Hive tables and worked on them using Hive QL, which will automatically invoke and run MapReduce jobs in the backend., Managing and scheduling batch Jobs on a Hadoop Cluster using Oozie., Experienced in loading and transforming large sets of structured, semi-structured and unstructured data.,

Bank of America (BOFA), 03/01/16 - 03/31/18, Spark, Hive, Shell Scripting, Impala, TWS, Oozie, Responsible for building distributed data solutions using Hadoop. Experienced in loading and transforming large sets of structured, semi-structured and unstructured data Hadoop concepts., 

Languages

English
First Language
English
Proficient (C2)
C2
Hindi
Advanced (C1)
C1
Telugu
Proficient (C2)
C2

Timeline

Azure Data Engineer

Atos Eviden
03.2021 - 12.2024

Data Engineer

KARTEL Technosoft Pvt Ltd
01.2016 - 01.2021

Bachelor of Computer Degree -

William Carey University

Board of intermediate education -

Board of intermediate education

SSC -

Board of Secondary Education
Sai Swaroop