AWS
Shinoj Philip John
Melbourne
Summary
Experienced Data Engineer with 2 years of expertise in designing, implementing, and maintaining robust data warehouse solutions. Proficient in ETL processes, Python, R programming, SQL, and data modeling, with a strong focus on optimizing data storage and retrieval to support business intelligence and analytics. Adept at translating complex business requirements into scalable data architecture, ensuring data integrity and accessibility. Known for problem-solving skills, attention to detail, and a collaborative approach to delivering high-quality, reliable data solutions that drive informed decision-making.
Overview
2
2
years of professional experience
2
2
Certificate
Work History
Data Engineer
NBN Co Limited [Infosys Ltd]
05.2021 - 06.2023
- Performed Data Warehousing development activities using ETL (Extract, Transform, Load) techniques which involved extracting data from source AWS S3 Buckets and performing transformations using SQL and loading the transformed data into AWS Redshift using AWS EMR thus supporting the data needs of critical financial and reporting teams.
- Activities involved in SQL were DDL script creations for a wide range of target tables and views, updating of parameters and control tables in MYSQL with respect to the stakeholder requirements, also in compliance with E-R Diagram designs and JIRA user story requirements.
- Multiple SQL script were created for successful ETL process, in addition loading the delta data change for daily runs were performed with an additional SQL script.
- Created necessary yaml files and JSoN files in accordance with the ETL pipeline parameter requirements for effective ETL process.
- Created, loaded and scheduled automatic runs of jobs and jobstreams in IBM Work Scheduler and performed Unit Testing before handing over for System Integration Testing.
- Versioning tool such as GitHub was used for development, testing and production deployments and deployments for the various stages of development were performed into the development/testing/production AWS EMR using Jenkins pipelines before loading to final AWS Redshift Data Warehouse using EMR.
- Maintained data integrity and verifying pipeline stability.
- Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
- Performed final data extraction from AWS Redshift to AWS S3 and SharePoint Online (SPO) for ease of access for other teams.
- Performed System Integration Testing which involved various activities to confirm the smooth operation of the ETL SQL scripts with the various systems and frameworks involved such as AWS EMR, Jenkins, AWS Redshift AND IBM Work Scheduler, also analyzed for necessary missing data not captured by the ETL process and gave feedback for design errors as part of testing.
- Performed UAT support to enable successful approval for Production deployment which involved business meetings with Business Analysts and stakeholders and created feature documentation for the various feature releases involved.
- Performed Pre-Production and Production Deployment which involved coordination with the operations team and stakeholders and successful running of the jobs involved in the Pre-Production and Production environment.
- Performed critical manual job runs using AWS EMR.
Trainee Electrical Engineer
Kerala State Electricity Board (K.S.E.B.)
06.2018 - 07.2018
- Performed internship in a 110kV substation and assisted the senior engineers in the various activities involved in the functioning of the machinery used.
- Learnt Single Line Diagram and the process of power distribution and transmission in a city.
Education
Master of Science - Analytics
RMIT University
Melbourne, Australia06.2025
Bachelor of Technology - Electrical And Electronics Engineering
APJ Abdul Kalam Technological University
Kerala, India09.2020
12th [C.B.S.E.] -
The Indian High School
Dubai, U.A.E.03.2016
Skills
- ETL development
- Data Warehousing
- Data Modeling
- SQL Expertise
- Data Analysis
- R Programming
- Python Programming
- Excel Functions
- Data Visualization and Presentations
- Data Science
- Teamwork and Collaboration
- Project Management
Certification
- Infosys Certified AWS Cloud Practitioner
- Infosys Certified Global Agile Developer Certification
Software
SQL
Python
R Programming
UNIX
GitHub
Jenkins
Java
SAS
Pandas
Numpy
Scikit-learn
Ggplot
Matplotlib
SSIS
SSAS
SSRS
Oracle DB, MySQL DB, Microsoft SQL Server, Redshift
IWS
Timeline
Data Engineer
NBN Co Limited [Infosys Ltd]
05.2021 - 06.2023
Trainee Electrical Engineer
Kerala State Electricity Board (K.S.E.B.)
06.2018 - 07.2018
Master of Science - Analytics
RMIT University
Bachelor of Technology - Electrical And Electronics Engineering
APJ Abdul Kalam Technological University
12th [C.B.S.E.] -
The Indian High School
Accomplishments
- Second Prize in Malayalam Debate, National Level Intercollegiate Fest.
- Bronze Medal for 4x100m Relay in Annual College Athletics Meet.
- Participated in Present Around the World Competition held at MBCET (IET).
- Participated in English Debate, National Level Intercollegiate Fest.
- Participated in Medical Hackathon CURATHON conducted by IEEE-MBCET.
Interests
Public Speaking
Reading
Photography
Music
Poetry
Hyper Realistic Drawing
Languages
English
Bilingual or Proficient (C2)
Malayalam
Bilingual or Proficient (C2)
Hindi
Bilingual or Proficient (C2)
Similar Profiles
Uma KarambelkarUma Karambelkar
Technical Test Lead at Infosys | nbn CoTechnical Test Lead at Infosys | nbn Co
Jagjot SinghJagjot Singh
Telecom Technician at NBN COTelecom Technician at NBN CO
Steven Kou VueSteven Kou Vue
Sub contractor for Service Stream(NBN) Telecommunications at Service Stream(NBN)Sub contractor for Service Stream(NBN) Telecommunications at Service Stream(NBN)