Summary
Overview
Work History
Education
Timeline
Data Engineering Competencies
SoftwareEngineer

Saravanan JG

Data Engineer
Malvern, PA

Summary

14-year background transitioning from Full Stack Developer to seasoned Data Engineer, adept in software architecture, system design, and data processing. Excel as a Senior Software Engineer, contributing across backend and frontend development. Specialize in ETL processes, data modeling, and database optimization, leveraging SQL, Python, and cloud technologies. Committed to crafting robust data solutions for actionable insights, prioritizing scalability, performance, and security.

Overview

2026
2026
years of professional experience
1
1
year of post-secondary education

Work History

Data Engineer

BNY Mellon Technology India Pvt Ltd
01.2023 - Current

Name Screening for Financial Risk Management:

Automates name screening in financial transactions to identify potential risks. Scans transaction data using regular expressions for specific keywords. Generates search results indicating potential risks associated with transactions. Enhances risk management and regulatory compliance in financial institutions.

Responsibilities:

  • Develop and configure Airflow Directed Acyclic Graphs (DAGs) to automate data loading processes into Snowflake. Ensure seamless data ingestion from various sources into Snowflake data warehouse using Airflow tasks.
  • Develop stored procedures and user-defined functions (UDFs) in Snowflake to implement regular expression-based token search. Utilize SQL and Snowflake's procedural language (e.g., Python - Snowpark) to create efficient search algorithms for identifying tokens of interest.
  • Design and implement Snowflake tables to store search results from regular expression token search. Develop data pipeline components to efficiently store processed data into Snowflake tables, ensuring data integrity and optimal performance.

Data Engineer

BNY Mellon Technology India Pvt Ltd
4 2021 - 12.2022

Compliance Data Mart:

A project aiming to centralize compliance data into a data lake (EDP) and establish a compliance data mart on the Enterprise Hadoop Platform (EHP) for reporting purposes.

Responsibilities:

  • Designing and constructing data processing pipelines in Hadoop ecosystem.
  • Extracting and loading data from RDBMS/REST APIs into HDFS using Python.
  • Utilizing SQOOP to interact with various RDBMS such as Oracle DB and MySQL.
  • Optimizing Hive schema performance through bucketing and partitioning.
  • Implementing end-to-end big data pipelines with Apache Airflow.
  • Enhancing Spark code for data aggregation and running pipeline tasks.
  • Conducting analytics by joining tables using PySpark.
  • Engaging in full development life cycle and team management.
  • Collaborating with stakeholders and solution architects to shape data pipeline designs.
  • Ensuring adherence to data governance and security policies.

Lead Application Developer

BNY Mellon Technology India Pvt Ltd
01.2019 - 02.2021

Resiliency Life Cycle Management (RLM): A web-based tool for disaster recovery testing, monitoring, and recording recovery activities at the application and business service levels.

Responsibilities:

  • Applied various J2EE design patterns (DTO, DAO, Builder, Singleton, Factory).
  • Developed Data Access Layer (DAL) using Spring Data and Hibernate ORM.
  • Implemented Spring Core for Inversion of Control (IOC) and Restful web services.
  • Integrated RESTful web services with application.
  • Led a team of 10 offshore developers, providing coaching and mentoring.
  • Practiced SCRUM agile methodology for design and development across diverse platforms and technologies.

Technical Lead

BNY Mellon Technology India Pvt Ltd
04.2015 - 12.2018

Service Level Agreement:

SLM is structured around defined processes and SLAs, covering both business and system processes with multiple activities. Process flow definitions are essential for record processing and SLA calculation.

Responsibilities:

  • Leveraged Spring Framework for middle-tier application development.
  • Implemented persistence with Spring and Hibernate for seamless database integration.
  • Developed all functionalities using Spring Boot and Hibernate ORM.
  • Employed Java EE components like Spring REST, Spring IOC, and Spring transactions, managing security via Spring Security.
  • Utilized Spring Core, Spring JDBC, and Spring Data extensively.
  • Managed source control and versioning with GIT.
  • Conducted code reviews and provided feedback on fellow developers' work.

Programmer Analyst

Cognizant Technology Solution
08.2012 - 04.2015

Policy Administration System (PAS):

Enhancing AAA business's policy administration system for improved efficiency and customer service.

Responsibilities:

  • Configuring products and business rules.
  • Writing JUnit test cases.
  • Collaborating on integration modules for online quoting and rating.

Software Engineer

SOLVERMINDS Solutions and Technologies Pvt Ltd
04.2010 - 06.2012

LINE Resource Planning System (LRP):

An ERP solution automating Emirates Shipping Line operations.

Responsibilities:

  • Developing and testing code for modules.
  • Providing periodic development updates to Project Leader.

Education

Post Graduate - MACHINE LEARNING

The University of Texas At Austin | GREAT LEARNING
Texas
03.2021 - 11.2021

Bachelor of Engineering Degree - Electronics and Communication Engineering

P.S.N.A. College of Engineering And Technology, Anna University
Dindigul, TN
08.2005 - 2009.05

Timeline

Data Engineer

BNY Mellon Technology India Pvt Ltd
01.2023 - Current

Post Graduate - MACHINE LEARNING

The University of Texas At Austin | GREAT LEARNING
03.2021 - 11.2021

Lead Application Developer

BNY Mellon Technology India Pvt Ltd
01.2019 - 02.2021

Technical Lead

BNY Mellon Technology India Pvt Ltd
04.2015 - 12.2018

Programmer Analyst

Cognizant Technology Solution
08.2012 - 04.2015

Software Engineer

SOLVERMINDS Solutions and Technologies Pvt Ltd
04.2010 - 06.2012

Bachelor of Engineering Degree - Electronics and Communication Engineering

P.S.N.A. College of Engineering And Technology, Anna University
08.2005 - 2009.05

Data Engineer

BNY Mellon Technology India Pvt Ltd
4 2021 - 12.2022

Data Engineering Competencies

  • Programming Languages: Java17, Python 3.11, SQL- Oracle and MS-SQL
  • Backend Development Framework: Spring Framework
  • Database Management Systems: Snowflake, MySQL, PostgreSQL
  • Big Data Technologies: Hadoop, Hive, Sqoop, Spark Core, Spark SQL, PySpark
  • Cluster Management: Cloudera Manager CDP 7.x
  • Cloud Data Warehousing: Snowflake on Azure Cloud
  • Data Pipeline Orchestration: Apache Airflow 2.x
  • Cloud Data Storage: AWS Simple Storage Service (S3)
  • Build & Deployment Tools: Git, Maven, Jenkins, Docker, CI/CD
  • Familiarity with Python Web Frameworks: Django, Flask
  • IDE Proficiency: Jupyter Notebook, PyCharm, IntelliJ IDEA
  • Machine Learning Libraries: Scikit-Learn, NumPy, SciPy, Matplotlib, Pandas, Statsmodels
  • Data Analysis Skills: ML Algorithms, Predictive Analysis, Data Visualisation, Statistical Analysis, EDA
  • Specialized Techniques: Regression, Clustering, Regularisation, Model Development
Saravanan JGData Engineer