AMBER AGARWAL

• Led Data Engineering offsite efforts in India for Data Foundations team, ensuring end to end data delivery, sustainable infrastructure scalability, mitigating data platform downtime and ensuring cross functional engagements to pursue risk and compliance checks.
• Enhanced Kafka setup performance by optimizing infrastructure configurations , thereby reducing operational and licensing cost to 70%.
• Successfully offboarded firm's mainstream querying platforms Okera and Superset, ensuring smooth migration to AWS Redshift
• Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.
• Contributed significantly towards setting up an automated data onboarding/monitoring mechanism using state-of-the-art technologies and tools, which led to proactive issue identification and monitoring.
• Mitigated security risks by conducting regular vulnerability assessments and applying necessary patches.

• Data Engineer with specialization in Cloud Data Warehousing & DevOps Solutions
• Led a team of 6 associates, worked as a Solution Architect, architected a Data Migration Plan for an existing on premise system to AWS Cloud via Data Warehousing solutions
• Designed, implemented and automated Audit mechanism process for data loads which reduced time & effort for data validation by 95%
• Developed close to 6 SPs for Near Real Time Ingestion Design, providing a crucial reference point to newly designed Ingestion process
• Significantly contributed in Record Reconciliation process, identifying orphan records to reduce data redundancy by 90%
• Experience into Project Estimations, developing Accelerators, Utilities, Reusable Components, POCs thereby improving Productivity & seeking additional business
• Techno Functional Consultant with specialization in Healthcare, Life Science & Insurance domains, handling clients across globe

• Data Engineer having rich experience in Cloud Data Architecture, Database Architecture, Data Analysis, Design & Development of BI and ETL solutions

• Designed migration framework on-premise data & system architecture on AWS set up, via data warehousing solutions using AWS Glue & Redshift

• Agile Competent, robust hands-on experience on Glue, Redshift, EC2, Python, S3, Athena, Airflow, Jenkins, GIT & Bit Bucket