Summary
Overview
Work History
Education
Skills
PS Number
Timeline
Generic
Revathi Rajendran

Revathi Rajendran

Chennai

Summary

  • Having 7+ years of experience as Data engineer in Talend open Studio, ETL, SQL, Aurora, AWS GLUE, RDS, Snowflake.
  • Worked in ODS and Bond- BSI Project and three POC from AWS S3 to Aurora, Aurora to snowflake, Aurora to SQL Server. Broad design, development and testing experience with Talend Integration Suite and knowledge in Performance Tuning of mapping.
  • Created multiple jobs for loading data with different database connections and run the job. Experience in Creating mapping in Talend using tFileInputDelimited, tMap,tJoin,tlogrow, tfilter,tAggregrate, tReplicate,tRow,tlogcatcher,tfilelist,tp tjava,tjava row,tDBSCD, tsortrow.
  • Designed and developed generic and flexible Talend framework for extracting the data from TRV S3 to Aurora database.
  • Worked in Talend Administrative center to schedule the job and run the job in parallel, Worked in Autosys job tool to schedule the job for successive and predecessor run.
  • Dynamically reading the schema for each file and reading data from S3 bucket and load into multiple database Parallel mechanism - Talend framework for higher load-carrying capacity, improved accuracy and increased stiffness Restartability - Record the point of failure.
  • Logging mechanism - To track the source and destination of data, the time of extraction and transformation, and any errors or warnings that occur during the process.
  • Sending email to recipient in case of success or failure of ETL process with detailed information.
  • Automated the framework to improve Data Validation and Data Quality.
  • Organized and dependable candidate successful at managing multiple priorities with a positive attitude.
  • Willingness to take on added responsibilities to meet team goals.

Detail-oriented team player with strong organizational skills. Ability to handle multiple projects simultaneously with a high degree of accuracy. Organized and dependable candidate successful at managing multiple priorities with a positive attitude. Willingness to take on added responsibilities to meet team goals.

Overview

1
1
year of professional experience

Work History

Bond- ODS (AWS S3 to Aurora)

Travelers
03.2023 - Current
  • Designed and developed generic and flexible Talend framework for extracting data from TRV S3 to Aurora database
  • Well-designed framework it can adapt changes as per project need for loading tables
  • Dynamically reading schema for each file and reading data from S3 bucket and loading into Aurora Database
  • Implemented SCD Type 2 to track historically significant attributes
  • Parallel mechanism - Talend framework for higher load-carrying capacity, improved accuracy, and increased stiffness Restartability - Record point of failure
  • Resume from point of failure without re-running successfully executed code
  • Logging mechanism - To track source and destination of data, time of extraction and transformation, and any errors or warnings that occur during process
  • Sending email to recipient in case of success or failure of ETL process with detailed information
  • Automated the framework to improve Data Validation and Data Quality.

Bond- ODS (AWS S3 to Snowflake)

Travelers
03.2023 - Current
  • Designed and developed generic and flexible Talend framework for extracting data from TRV S3 to Aurora database
  • Well-designed framework it can adapt changes as per project need for loading tables
  • Dynamically reading schema for each file and reading data from S3 bucket and loading into Aurora Database
  • Implemented SCD Type 2 to track historically significant attributes
  • Parallel mechanism - Talend framework for higher load-carrying capacity, improved accuracy, and increased stiffness Restartability - Record point of failure
  • Resume from point of failure without re-running successfully executed code
  • Logging mechanism - To track source and destination of data, time of extraction and transformation, and any errors or warnings that occur during process
  • Sending email to recipient in case of success or failure of ETL process with detailed information
  • Automated the framework to improve Data Validation and Data Quality.

Bond- ODS (AWS S3 to SQL Server)

Travelers
04.2023 - Current
  • Designed and developed generic and flexible Talend framework for extracting the data from TRV S3 to Aurora database
  • Well-designed framework it can adapt the changes as per project need for loading the tables
  • Dynamically reading the schema for each file and reading data from S3 bucket and loading into Aurora Database
  • Parallel mechanism - Talend framework for higher load-carrying capacity, improved accuracy and increased stiffness Restartability - Record the point of failure
  • Resume from the point of failure without re-running successfully executed code
  • Logging mechanism - To track the source and destination of data, the time of extraction and transformation, and any errors or warnings that occur during the process
  • Sending email to recipient in case of success or failure of ETL process with detailed information
  • Automated the framework to improve Data Validation and Data Quality.

Bond- BSI (Written Premium Cloud)

Travelers
10.2022 - 3 2023
  • Designed and developed generic and flexible Talend framework for extracting the data from SQL Server into Snowflake
  • Well-designed framework it can adapt the changes as per project need for loading the tables
  • Created new metadata table in snowflake raw layer and by schema and load financial tables (e.g
  • Finmis, Fiprip, rpts tables) from SQL Server
  • Dynamically reading the schema for each file and reading data from Written premium tables, Data mart tables and loading into Raw layer of Snowflake
  • Implemented SCD Type 2 to track historically significant attributes
  • Parallel mechanism - Talend framework for higher load-carrying capacity, improved accuracy, and increased stiffness Restartability - Record the point of failure
  • Resume from the point of failure without re-running successfully executed code
  • Logging mechanism - To track the source and destination of data, the time of extraction and transformation, and any errors or warnings that occur during the process
  • Sending email to recipient in case of success or failure of ETL process with detailed information
  • Automated the framework to improve Data Validation and Data Quality.

Education

Bachelor of Engineering - Computer Science

Akshaya College of Engineering And Technology
Coimbatore

Skills

    Domain: Data Engineering, Language, Skills: Talend Open Studio 80 , Microsoft SQL,RDS, Aurora, RDS, Snowflake, AWS Glue, Projects: Bond-BSI and Bond-ODS ( Data Ingestion Framework), Tools / DB / Packages / Framework / ERP Components: Talend Open Studio 80 , Microsoft SQL,RDS, Aurora, RDS, Snowflake, AWS Glue, Putty, Autosys, Talend Administrative Center

    ETL development

PS Number

10716438

Timeline

Bond- ODS (AWS S3 to SQL Server)

Travelers
04.2023 - Current

Bond- ODS (AWS S3 to Snowflake)

Travelers
03.2023 - Current

Bond- ODS (AWS S3 to Aurora)

Travelers
03.2023 - Current

Bond- BSI (Written Premium Cloud)

Travelers
10.2022 - 3 2023

Bachelor of Engineering - Computer Science

Akshaya College of Engineering And Technology
Revathi Rajendran