Aman Gupta

Role: Lead Data Engineer

Azure Databricks, Azure Purview, GCP Big Query, Dataprocs,Dataforms, AWS Glue, Athena, S3 buckets

Department of Government Enablement, Abu Dhabi: Led the implementation of an enterprise data governance framework using Microsoft Purview, with a scalable data quality engine built on Azure Databricks to automate validation across cataloged data assets. Enabled downstream consumption by integrating curated datasets with reporting applications, delivering unified, dashboard-ready insights.

Lendlease: Designed a GCP-native data platform using Medallion Architecture, orchestrating data ingestion and transformation via Google BigQuery, Google Dataproc, and Dataform. Engineered Python-based, YAML-driven frameworks for dynamic pipeline configuration, supporting raw ingestion (Bronze), data harmonization (Silver), and business logic-driven transformations (Gold/Palladium).

Converge: Designed and delivered a geospatial analytics solution to analyze foot traffic patterns, enabling stakeholders to track location-based visit volumes across defined time intervals.

• Streamlined data ingestion processes to accommodate increasing volumes of incoming information while maintaining data integrity and ensuring timely accessibility across the organization.
• Aligned business objectives with technical requirements through close collaboration with product owners providing insights based on available data sources.
• Mentored junior engineers on best practices in data engineering, fostering a culture of continuous learning and improvement within the team.
• Identified areas for improvement within existing ETL frameworks to maximize efficiency without sacrificing accuracy or integrity of results produced during transformations applied on ingested datasets.
• Collaborated with cross-functional teams to gather requirements, ensuring seamless integration of data engineering solutions into existing systems.

Role: Data Engineer

Azure Databricks, Hive, Advanced SQL, PySpark, Scala, Kafka, Hadoop, Gen AI (LLAMA2)

Adobe MCE: Spearheaded a project to deliver data to consumers through an ETL (Extract, Transform, Load) system, facilitating targeted and personalized marketing strategies.

Adobe Axon: A robust data integration solution to publish data from the Hadoop File System (HDFS) to Kafka system, leveraging advanced technologies and frameworks.

Adobe Aware: Designed and implemented a chat-assistant tool integrated with Slack, leveraging LLAMA2 to process and learn from a variety of documents. Utilized NLP techniques to enable the tool to effectively understand and respond to user queries, enhancing user interaction and support.

Roles:

• Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
• Enhanced data quality by performing thorough cleaning, validation and transformation tasks.
• Analyzed complex data to identify anomalies, trends, and risks, providing valuable insights for improving internal controls.
• Troubleshot issues by diagnosing root causes and devising effective solutions.

Core Java, Spring MVC, SQL, JUnit, Jenkins (CI/CD), Git

• Vendor Contract Management System (VCMS) is centralized repository for all vendor contracts that happens among TCS, Client and vendors.
• Bank Guarantee System (BGS) is central system to facilitate/maintain Bank Guarantee for Service Level Agreements (SLA) between TCS and Business
  Partners.
• Integrated Payment Approval and Management System (IPAMS) is centralized portal for payment approval to different banks initiated by finance users.

Roles

• Designed updates to existing software to meet changing customer demands.
• Setting up environment for deployment using CI/CD(Continuous Integration/Continuous Deployment) using Jenkins.
• Proved successful working within tight deadlines and a fast-paced environment.

Core Java, Angular 2, MySQL, Jenkins, JBoss

Symantec Payment Gateway Integration : Developed and integrated a Payment Gateway Interface for Symantec, facilitating transactions for Indian customers purchasing Norton products via Symantec's website. Managed payment operations, including invoicing, credit notes, and compliance with Indian government taxation, in collaboration with Netprophets Cyberwork Pvt. Ltd.

Roles

• Designed and coded software modules based on guidance from supervisors and client requirements, encompassing planning, design, and
  development.
• Invoice, Credit Note, Refund and Receipt PDF generation using Java.
• Upgraded application from java 6 to java 8 to meet PCI-DSS compliance.