Detail-focused data engineer with over 4 years of expertise in AWS cloud services, specializing in data pipeline development, database management, and performance monitoring and proven ability in translating customer requirements into actionable project plans with experiences in Python, Spark, and SQL.
Role: AWS Data Engineer
Duration: Jul 2024 till date
1. Working in Data Structuring, Cleaning, and Insight Generation by transforming raw data from S3 using AWS Glue and PySpark, creating structured tables in AWS Athena for Business Intelligence and analytics in AWS Quicksight.
2. Working in Data Pipeline Maintenance and Enhancement by automating AWS Glue Python scripts using AWS Glue Workflow to generate fact, dimension, and analytical tables for reporting.
3. Working in System Performance Optimization by leveraging AWS CloudWatch to monitor and optimize AWS Glue worker node utilization, improving cost efficiency and execution time.
Role: AWS Support
Duration: Jul 2023 to Jul 2024
1. Working in System Monitoring and Incident Management by tracking and analyzing CloudWatch logs, proactively identifying and resolving issues in a railway organization's customer booking system.
2. Working in Data Pipeline Maintenance and Enhancement by configuring AWS Lambda functions, automating error log processing via SES, and improving system monitoring with CloudWatch alarms for AWS DynamoDB and AWS RDS.
3. Working in Data Preparation for Reporting and Decision-Making by generating detailed error analysis reports, enabling the technical team to make informed decisions and ensure system stability.
Role: Data Analyst
Duration: Feb 2023 to Jun 2023
1. Contract Data Analyst supporting a leading global tech client , partnering with cross-functional stakeholders to deliver analytics and BI outcomes.
2. Designed and implemented archival and recovery solutions using GCP services i.e. Cloud Composer and BigQuery, improving data retention reliability.
3. Performed data reconciliation of single-source-of-truth tables against origin systems to ensure archival accuracy and lineage.
4. Built and deployed incremental ETL pipelines using industry practices including watermarking to reduce load times and prevent duplicates.
5. Delivered Looker dashboards for ad‑hoc and surge analytics needs , offloading pressure from internal reporting and improving time‑to‑insight.
1. Working in Data Insight Generation for Business Intelligence by designing and developing KPI dashboards and operational reports in Power BI to support decision-making across multiple manufacturing units.
2. Managing Data Processing and Workflow Optimization by identifying and resolving data inconsistencies using SQL, optimizing data flow, and ensuring scheduled data updates for accurate reporting.
3. Working in Data Modeling and Report Optimization by structuring data for efficient querying and visualization, improving report performance and accuracy in Power BI.
1. Working in Product Development and UX Optimization by leading the development of a career-building website, defining product vision, and ensuring alignment with stakeholder requirements.
2. Working in UI/UX Design and Implementation by designing and developing over 80 user-friendly web pages, focusing on usability, accessibility, and stakeholder specifications.
3. Working in Agile Product Management and Team Collaboration by managing a cross-functional team, overseeing development sprints, and ensuring timely delivery of milestones while mitigating potential risks.
4. Performing in an Agile Capacity and Sprint Execution by managing the product backlog, prioritizing development initiatives, and tracking progress through Jira to ensure continuous improvement.
5. Ensuring Quality and Enhancing Usability by conducting user testing, gathering feedback, and implementing refinements to improve website functionality and user experience.