Summary
Overview
Work History
Education
Skills
Intership
Projects
Timeline
Generic

ARAVINDA REDDY M

BANGALORE

Summary

  • Proficient in designing and developing ETL pipelines for data integration and transformation.
  • Good experience in using JDBC and created PYSPARK scripts to load data from RDBMS to DBFS.
  • Experience in ADF data flows, SQL DB, ADLS gen2, blob storage, MySQL.
  • Developed PySpark scripts using both Data frames/SQL and RDD in Spark Databricks for Data aggregation.
  • Worked on poc for converting SQL script to PySpark script using azure Databricks.
  • Worked on RDD's and Data Frames.
  • Experienced in SQL querying, data manipulation, and performance optimization using MySQL.
  • Used Spark-SQL for querying & transformation of data residing in local databases as well as data ware houses.
  • Good experience in integrating AZURE DATABRICKS to Azure services like AZURE BLOB and ADLS.
  • Good in adopting to new technologies and implementing them

Overview

3
3
years of professional experience

Work History

Software Engineer

Source One Pvt Ltd.
Hyderabad
05.2022 - Current
  • Client Overview: CoreLogic, Inc
  • Is an Irvine, CA-based corporation providing financial, property, and consumer information, analytics, and business intelligence.
  • The company analyzes information assets and data to provide clients with analytics and customized data services.
  • Extracting data from source systems, and applying business logic using Apache Spark.
  • Developed PySpark scripts using both DataFrames/SQL and RDD in Spark Databricks for data aggregation.
  • Worked with the CSV file format and used various compression techniques to leverage the storage.
  • Used complex Spark SQL joins to filter out the data redundancy.
  • Involved in creating tables, loading, and analyzing data using queries on Deltalake.
  • Implemented data quality checks and validation rules to ensure data accuracy and integrity.
  • Implemented data transformation and aggregation by using PySpark.
  • Mounted Azure Blob Storage to DBFS in Azure Databricks.
  • Optimized Spark jobs for performance by tuning configurations, using appropriate data structures.

Software Engineer

Source One Pvt Ltd.
Hyderabad
05.2022 - 03.2023
  • Company Overview: Eli Lilly is an American pharmaceutical company headquartered in Indianapolis, Indiana, with offices in 18 countries.
  • Experience with the Microsoft Azure portal, Azure SQL Database.
  • Proficient in data integration using Azure Data Factory, leveraging components such as pipelines, activities, and datasets.
  • Design and develop data pipelines using Azure Data Factory to move and transform data from various sources to target data stores.
  • Implemented data transformation, aggregation, and movement solutions within ADF
  • Monitored pipeline runs, diagnosed issues, and optimized performance to enhance data processing efficiency.
  • I came up with several programs to ensure correct data transfer.

Education

Bachelor of Technology -

GITAM University
Bengaluru
01.2022

Intermediate -

Narayana Junior College
Kadapa
01.2018

10th -

Narayana School
Kadapa
01.2016

Skills

  • Azure SQL
  • MySQL
  • Pyspark
  • Databricks
  • Python
  • SQL

Intership

Pragyan AI

Project Intern - 2022

  • Led an audio analysis project on Emotion Speech Recognition using Librosa package in Python programming.
  • Performed data preprocessing, feature engineering, and classifier training to classify speech signals and recognize emotions from audio sources using packages in Python such as soundfile, librosa.
  • Developed a predictive model that determined emotions such as happiness, sadness, anger, neutral, etc.
  • Delivered the presentation and results to the management and created a detailed report on the project.

Projects

Detection of Driver Drowsiness using Python - 2021

  • Analyzed video sequence of four-wheeler driver to detect person's vigilance level to reduce/avoid accidents.
  • Utilized 16,000 images in .png format to train & test the data science algorithm using Python program.

Face Mask Detection using Python - 2022

  • Built a face mask detector model using functions in data science and ran the model on Raspberry Pi.
  • Performed in-depth modeling task to classify "with mask" and "without mask" while training the model.
  • Achieved a 99.29% model accuracy using MobileNetV2 algorithm compared to other data science algorithms, resulted in precise face mask detection.

Timeline

Software Engineer

Source One Pvt Ltd.
05.2022 - Current

Software Engineer

Source One Pvt Ltd.
05.2022 - 03.2023

Bachelor of Technology -

GITAM University

Intermediate -

Narayana Junior College

10th -

Narayana School
ARAVINDA REDDY M