Udhaya Udhaya
Chennai
Summary
Seasoned Data Engineer with a proven track record at Box Infocom Pvt Ltd, leveraging expertise in Python, SQL, and AWS to streamline data processes and enhance analytical capabilities. Skilled in fostering stakeholder relationships and optimizing ETL performance, achieving significant project milestones with innovation and efficiency.
Overview
4
4
years of professional experience
Work History
Data Engineer
Box Infocom Pvt Ltd
03.2022 - 01.2024
- Worked with various file formats to extract data and apply data transformation using Glue studio and load in S3
- Using unload technique data from S3 will be loaded in client specific redshift tables
- Utilized Athena to apply analytical queries and transformation on data that resides in S3
- Created lambda functions to enable event trigger that initiates glues job when an object update happened in S3
- Integrating Amazon cloud watch with EC2 instances for monitoring the log files track files
- Creating topics in SNS to send notifications to subscribers as per the requirement
- Creating highly available environments using auto-scaling, load balancers, and SQS
- Used IAM to create new accounts, roles and groups created client specific schema in Redshift and multiplexed the data to corresponding redshift table
- Worked in AWS cli and Boto3 to play with the AWS resources programmatically
- Converting the existing PostgreSQL scripts to Athena scripts
- Worked on the creation of the design, development of the code
- Creation of the complex SQL queries using joins, worked on materialized views
- Provided the documentation for the release notes to the production team to implement
- Provided the production support at the time of release to clarify the doubts to production team
- Interaction with the production team to clarify the production issues
- Created complex OLAP queries with required business logic applied
- Involved in development of shell scripts to send invoices to customers through mailing
- Document ETL processes and metadata, optimize ETL performance
- Collaborate with application developers and data analysts to meet database related requirements
Data Engineer
Msys Technologies Pvt Ltd
03.2022 - 01.2024
- Worked with various file formats to extract data and apply data transformation using Glue studio and load in S3
- Using unload technique data from S3 will be loaded in client specific redshift tables
- Utilized Athena to apply analytical queries and transformation on data that resides in S3
- Created lambda functions to enable event trigger that initiates glues job when an object update happened in S3
- Integrating Amazon cloud watch with EC2 instances for monitoring the log files track files
- Creating topics in SNS to send notifications to subscribers as per the requirement
- Creating highly available environments using auto-scaling, load balancers, and SQS
- Used IAM to create new accounts, roles and groups created client specific schema in Redshift and multiplexed the data to corresponding redshift table
- Worked in AWS cli and Boto3 to play with the AWS resources programmatically
- Converting the existing PostgreSQL scripts to Athena scripts
- Worked on the creation of the design, development of the code
- Creation of the complex SQL queries using joins, worked on materialized views
- Provided the documentation for the release notes to the production team to implement
- Provided the production support at the time of release to clarify the doubts to production team
- Interaction with the production team to clarify the production issues
- Created complex OLAP queries with required business logic applied
NPI Engineer
Flextronics Technologies Pvt Ltd
03.2020 - 02.2022
- Designed and implemented efficient data models, load scripts, and visualizations in Power BI to fulfill business requirements
- Collaborated closely with stakeholders to gather requirements and translate them into QlikView solutions
- Created and modified analytical reports, utilizing Power BI's forecasting feature to provide predictive insights
- Leveraged advanced analytics to forecast future trends and add value to project outcomes
- Engaged clients effectively to ensure alignment with project objectives and satisfaction throughout
- Applied MRP expertise to streamline processes and optimize inventory management
- Coordinated with vendors to ensure timely material delivery, minimizing project risks
- Managed project timelines effectively, ensuring timely deliverables
Education
Bachelor in Technology - EEE
NPSB College of Engineering
06.2017
Skills
- Python
- PySpark
- SQL
- Shell scripting
- Glue
- EMR
- Databricks
- Redshift
- Athena
- RDS
- S3
- EC2
- Lambda
- Cloud Watch
- SQS
- SNS
- ECS
- CRON jobs
- Autosys
- AWS
- GitHub
- Code Commit
- Microsoft Windows Server 2008/12/16
- Linux
- JIRA
- SQL workbench
- Hadoop
Timeline
Data Engineer
Box Infocom Pvt Ltd
03.2022 - 01.2024
Data Engineer
Msys Technologies Pvt Ltd
03.2022 - 01.2024
NPI Engineer
Flextronics Technologies Pvt Ltd
03.2020 - 02.2022
Bachelor in Technology - EEE
NPSB College of Engineering
Similar Profiles
Ahmad Shah BarakzaiAhmad Shah Barakzai
Internship Student at Caribbean Infocom India Pvt. Ltd (CII Pvt. Ltd)Internship Student at Caribbean Infocom India Pvt. Ltd (CII Pvt. Ltd)
ASHOK YadavASHOK Yadav
Accounts & Finance Executive at Icons Infocom Pvt Ltd.Accounts & Finance Executive at Icons Infocom Pvt Ltd.
JAY PATELJAY PATEL
Project Coordinator at Sapphire Infocom Pvt LtdProject Coordinator at Sapphire Infocom Pvt Ltd
Muthukumar RajendranMuthukumar Rajendran
Procurement Analyst at Newell BrandsProcurement Analyst at Newell Brands
Monika KMonika K
Billing Operation at ToastBilling Operation at Toast