AAMIR RIYAZ

• Architected and implemented ETL pipelines using Azure Databricks, ADLS, and Delta Lake for scalable big data processing and analytics.

• Enhanced performance and cost efficiency by optimizing Spark jobs, tuning cluster configurations, and reducing storage redundancy through Delta Lake optimizations.

• Integrated Azure Databricks with Synapse Analytics and other Azure services to deliver end-to-end data solutions, ensuring reliability and scalability for business-critical workflows.

• Led design and development of high-performance, scalable data processing system from inception to implementation.
• Crafted project's High-Level Design (HLD) and Low-Level Design (LLD) while ensuring optimization of costs and adherence to acceptance criteria.
• Utilized expertise in Big Data and Cloud technologies, specifically Azure and GCP, to architect solutions.
• Employed key technologies such as PySpark, Python, Scala, Azure Synapse, HDInsight, Kafka, EventHub, Azure SQL, and DeltaLake.
• Designed and implemented effective database solutions and models to store and retrieve data
• Established DataMart for reporting team, utilizing Data Warehouse as source and creating Transaction layer with aggregated values.

• Developed custom Python libraries using Spark for to deliver business requirement's in big data processing and analysis in Databricks notebooks.
• Created comprehensive documentation for Python libraries, utilizing Sphinx to generate dynamic HTML documents.
• Optimized and innovated Spark jobs, transforming data processing performance from minutes to seconds. Implemented strategic enhancements.

• Led dynamic Agile Scrum Team as Senior Developer/Team Lead, specializing in Python-based code development using Spark framework.
• Led high-performing team 5 through the end-to-end development process of a Big Data Application, from the conceptualization phase to successful production deployment. Coordinated the team's efforts in designing and implementing scalable and efficient data processing solutions, ensuring the application met all functional requirements and performance benchmarks.
• Resolved and implemented complex technical needs for project, including new developments, product design, and legacy system upgrades.
• Successfully migrated legacy Informatica PowerCenter ETL processes to a modern, scalable solution using Scala, Spark, and Hadoop. Leveraged expertise in both legacy and emerging systems to ensure a seamless transition.
• Designed and implemented robust framework for ingesting data from Kafka topics to database, providing high-end CI/CD solution.

• Understanding Requirements and Creating Requirement Analysis and STTM Documents
• Developed ETL workflows, sessions, mappings using Informatica Power Center as per the requirement.
• Implemented SAP BW connectivity with Informatica. And triggering SAP Process Chain from Informatica and fetching data from Open HUB Destination.
• Worked on Performance Tuning of Informatica Mappings/sessions.
• Worked with different source/Target systems : Database(Oracle),Flat File, SalesForce and SAP BW
• Performed root cause analysis on all processes and resolve all production issues and validate all data
• Unit testing ETL code to ensure it can be delivered and run in a system testing environment.
• Develop Informatica Cloud ETL code based on requirement and Data Model.
• Developed Linux Shell Script for Process Orchestration