Aman Lahariya

• Developed AWS Glue ETL pipelines for efficient API - based data Ingestion into data lakes.
• Streamlined Devops Practices by implementing Git flow strategy enhancing team collaboration and deployment process.
• Design and delivered technical solution architecture for various projects.
• Worked on proof of concept to evaluate the suitability of snowflake for data ware housing and analytics, leading to informed technology decision.

Project details :

• Development of a Predictive Maintenance centered Asset Management Plan for the customer by leveraging different data sets and performing python spark/pandas based ETL on AWS Cloud.

Roles & responsibilities:

• Played a pivotal role in selecting appropriate AWS services for ETL processes, ensuring optimal performance, scalability, and cost-effectiveness.
• Led the development of architecture for data pipelines, encompassing robust design principles and best practices for efficiency and maintainability.
• Led and participated in ISO 27001-related audits, ensuring compliance with security standards and regulations.
• Designed, developed, and maintained data pipelines for data integration and ETL processes in AWS.
• Utilized tools such as Pandas and Apache Spark to write ETL processes for processing and analyzing large datasets.
• Worked with various data formats (JSON, CSV, Parquet), integrated APIs, and performed web scraping for data extraction.
• Implemented end-to-end data pipelines automating data ingestion, processing, and delivery, utilizing CI/CD and IaC methodologies.
• Evaluated data quality and resolved data quality issues, collaborating with cross-functional teams including data scientists, analysts, and stakeholders.

Project Details:

• Migration of data from on-prem to Enterprise Data Lake by creating ETL jobs on DataBricks Platform using pyspark and Creating insights for the Dealers based on the data to increase the market share.

Roles & Responsibility:

• Development of ETL Applications leveraging Spark on Databricks Platform, ensuring optimal performance and scalability.
• Creation and Management of infrastructure data pipelines, utilizing AWS services such as EC2 instances, SNS, Lambda, and EMR, orchestrated through AWS CloudFormation and CLI interface.
• Migration of on-premises data to an enterprise data lake on AWS, devising automated utilities to streamline data movement and process automation, significantly reducing manual efforts.

Project Details:

Development of MuleSoft API as a middleware on pivotal cloud foundry. Development of Customer Due Diligence backend Java based code using spring integration

Roles & Responsibilities:

• Developing Microservices Using Spring Boot
• Developing Jenkins job for automating build and deployment processes
• Developing Middleware api's using MuleSoft and Spring Integrations
• Creating Jenkins pipeline for packaging executing automated unit test and pushing packaged code to different environments.

Project Details:

Development of Backend Java API based Loan portal for retail customer to apply for different loan product by evaluating the edibility criteria based on credit report and multiple other factors , including facility for instant loan disbursal .

Roles & Responsibilities:

• Backend API development for ICICI Bank Loan Portal
• Developing Restful API's in Java