Summary
Overview
Work History
Education
Skills
Work Availability
Timeline
Generic
AAMIR RIYAZ

AAMIR RIYAZ

Sr. Data Engineer
Mumbai

Summary

Experienced Senior Data Engineer adept in Spark, Hadoop, Azure Synapse, ETL, Data Modeling, and Data Warehousing. Proven track record of designing and implementing efficient data solutions. Possesses strong analytical skills, excels in problem-solving, and has a deep understanding of database technologies and systems. Confident in working independently and collaboratively, with excellent communication skills to facilitate seamless interactions.

Overview

9
9
years of professional experience
8
8

Years of Data Engineering experience

5
5

Years of Azure Cloud experience

1
1

Years of GCP experience

5
5

Years of Kafka experience

Work History

Sr Data Engineer

Reliance Jio
Mumbai
05.2022 - Current


  • Led the design and development of a high-performance, scalable data processing system from inception to implementation.
  • Crafted the project's High-Level Design (HLD) and Low-Level Design (LLD) while ensuring optimization of costs and adherence to acceptance criteria.
  • Utilized expertise in Big Data and Cloud technologies, specifically Azure and GCP, to architect solutions.
  • Employed key technologies such as Pyspark, Python, Scala, Azure Synapse, HDInsight, Kafka, EventHub, Azure SQL, and DeltaLake.
  • Orchestrated seamless inventory updates through Spark via Kafka as the source, culminating in the creation of a file-based datamart.
  • Designed the Spark application architecture, implementing efficient design patterns to optimize performance and scalability.
  • Developed the initial structure of the Spark application, enhancing code efficiency for other developers on the team.
  • Ensured secure data management by designing a config-based application with password encapsulations via Azure KeyVault.
  • Established a DataMart for the reporting team, utilizing Datawarehouse as the source and creating a Transaction layer with aggregated values.

Lead Developer

TEK Systems, Bigdata/ Databricks
Pune
10.2021 - 05.2022


  • Directed multi-national team of junior developers, integrating disparate levels of experience and technical knowledge into cohesive efforts.
  • Developed custom Python libraries using Spark for enhanced data processing and analysis in Databricks notebooks.
  • Designed and implemented functions within the libraries, enabling non-technical users to seamlessly access and analyze data.
  • Created comprehensive documentation for the Python libraries, utilizing Sphinx to generate dynamic HTML documents.
  • Ensured clarity and ease of use through detailed docstrings, making it straightforward for users to understand and leverage the functionality.
  • Collaborated with cross-functional teams to gather requirements and refine library features based on user feedback.
  • Conducted training sessions to empower non-technical users in effectively utilizing the Python libraries for data exploration and analysis.

Senior Developer

Principal Global Services
03.2018 - 10.2021
  • Led a dynamic Agile Scrum Team as a Senior Developer/Team Lead, specializing in Python-based code development using the Spark framework.
  • Resolved and implemented complex technical needs for the project, including new developments, product design, and legacy system upgrades.
  • Designed and implemented a robust framework for ingesting data from Kafka topics to the database, providing a high-end CI/CD solution.
  • Implemented Infrastructure as Code (IaC) using Ansible, enhancing automation and deployment efficiency.
  • Demonstrated proficiency in Python, Scala, Spark, Hadoop, Hive, Db2Blu, Kafka, Ansible, and Denodo.
  • Proactively contributed to reducing Time to Market (TTM) and optimizing costs by implementing efficient CI/CD pipelines using BAMBOO and Ansible.

ETL Developer

Cognizant Technology Solutions
Pune
06.2015 - 03.2018
  • Understanding Requirements and Creating Requirement Analysis and STTM Documents
  • Did extensive Reverse Engineering in analyzing datastage jobs, UNIX scripts and their conversion to corresponding Informatica code and Linux scripts.
  • Developed ETL workflows, sessions, mappings using Informatica Power Center as per the requirement.
  • Implemented SAP BW connectivity with Informatica. And triggering SAP Process Chain from Informatica and fetching data from Open HUB Destination.
  • Worked on Performance Tuning of Informatica Mappings/sessions.
  • Worked with different source/Target systems : Database(Oracle),Flat File, SalesForce and SAP BW
  • Performed root cause analysis on all processes and resolve all production issues and validate all data
  • Unit testing ETL code to ensure it can be delivered and run in a system testing environment.
  • Develop Informatica Cloud ETL code based on requirement and Data Model.
  • Developed Infa-Cloud Mappings, Configuration Task with varied complexity
  • Developed Linux Shell Script for Process Orchestration

Education

B.Tech - Electronics & Communication Engineering

AMITY University
Uttar, Pradesh
2010.Jun - 2014.Jun

SSC 12th -

Dr. Virendra Swarup Education Center(C.B.S.E)
04.2008 - 03.2010

High School Diploma -

Dr Virendra Swaroop Education Center
04.2007 - 03.2008

Skills

    Big Data Stack : Hadoop, HDFS, Apache Spark, Python, Scala, Kafka, Hive, Apache Beam

undefined

Work Availability

monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse

Timeline

Sr Data Engineer

Reliance Jio
05.2022 - Current

Lead Developer

TEK Systems, Bigdata/ Databricks
10.2021 - 05.2022

Senior Developer

Principal Global Services
03.2018 - 10.2021

ETL Developer

Cognizant Technology Solutions
06.2015 - 03.2018

B.Tech - Electronics & Communication Engineering

AMITY University
2010.Jun - 2014.Jun

SSC 12th -

Dr. Virendra Swarup Education Center(C.B.S.E)
04.2008 - 03.2010

High School Diploma -

Dr Virendra Swaroop Education Center
04.2007 - 03.2008

Similar Profiles

CREATE PROFILE
AAMIR RIYAZSr. Data Engineer