Rohit Borkar

"2+ Years Experienced Data Engineer with expertise in Big Data Technologies and AWS Services. seeking opportunities to optimize data workflows, Maintain data integrity and data-driven insights. Proficient in SQL,Python and Cloud Technologies. Committed to driving innovation and data excellence.

Project 1: "Serverless Entity Extraction and Real-time Database Integration with S3, Lambda, and RDS"                           Nov 2022 - July 2023

Domain: Legal Domain.

Role :-Data Engineer

Project Goal : The goal of the project was to create Automated Data Processing Pipeline using Amazon Service.

Tools Used:

• Amazon S3
• AWS Lambda
• AWS Lambda Triggers
• Amazon RDS (Relational Database Service)
• Proactive Monitoring and Alerting Systems

"I designed and implemented an AWS data pipeline that utilized S3 for data storage, Lambda functions for data processing, Lambda triggers for automation, and RDS (Relational Database Service) for efficient data storage and retrieval. This streamlined pipeline enhanced data processing and improved the accessibility and performance of critical data analytics systems." 

Roles and Responsibilities:

• Developed and architected an end-to-end data pipeline leveraging AWS services, including S3 for data storage and AWS Lambda for data processing.
• Implemented Lambda triggers to automate data processing, enhancing system efficiency and reducing manual intervention.
• Engineered data transformations within Lambda functions, ensuring data quality and compatibility for downstream analytics.
• Managed and optimized an RDS (Relational Database Service) instance, ensuring data integrity, performance, and secure storage.
• Set up proactive monitoring and alerting systems to detect and address issues promptly, maintaining the reliability of the data pipeline.
• Attended daily scrum calls with the team and weekly scrum calls with the client.
• Held daily discussions with the team about daily tasks and feature goals.

Project 2 :   "AWS Data Format Transformation Automation" .                                                                                                       Dec 2021 - August 2022                                                                                                          

Role: Data Engineer

Project goal:  "To automate the transformation of data from CSV to Avro format within an AWS environment, enhancing data processing efficiency and improving data quality for downstream analytics." 

Tools used:  

• AWS Glue
• AWS Lambda
• Amazon S3
• Amazon RDS (Relational Database Service)
• AWS IAM (Identity and Access Management)

"Our project pipeline automated the transformation of CSV data to Avro format using AWS services. It began with data ingestion into an S3 bucket, triggering an AWS Lambda function. The Lambda function executed an ETL job through AWS Glue for data transformation. The transformed data was then stored in another S3 bucket. IAM policies and permissions were managed to ensure security and access control throughout the process."

Roles and Responsibilites: