About 2 years of experience as a Data Engineer, skilled in Python, PySpark, Pandas, and DataFrame. Proficient in Postgresql, MySQL, and API development.
Winverve-FLS
Role: Data Engineer
Client: FLSmidth
Technologies Used: Python, PySpark, Snowflake, PowerBI
Responsibilities:
• Collaborated with team members to understand project requirements and objectives, meeting all data processing needs.
• Developed Python scripts to extract data from multiple CSV files, transforming and cleaning the data to ensure accuracy and consistency.
• Utilized PySpark to handle large datasets, optimizing ETL processes for performance and scalability.
• Loaded transformed data into Snowflake, ensuring efficient data storage and accessibility for analysis.
• Engaged in regular client meetings to provide updates, gather feedback, and implement required changes to data processing workflows.
Leap-Shikshalokam
Role: Data Engineer
Client: Shikshalokam
Technologies Used: Python, API, PostgreSQL, MinIO.
Responsibilities:
• Extracted data from the client's server using Python scripts and API calls, creating structured CSV files for further processing.
• Stored the generated CSV files in MinIO buckets, managing data securely and efficiently.
• Developed Python scripts to perform data aggregation and analysis based on client requirements, delivering actionable insights.
• Uploaded processed and analyzed data back to the client's server, ensuring seamless integration and availability.
• Prepared detailed documentation of data processes and maintained regular communication with the client to understand requirements and provide updates.
QuestPLE
Role: Data Engineer
Client: Quest
Technologies Used: Python
Responsibilities:
• Developed Python automation scripts to extract and store specified code snippets in HTML and JavaScript files.
• Validated the accuracy and efficiency of the automation process, ensuring the integrity of the stored code.
• Created detailed documentation for the automation scripts, offering clear instructions for future maintenance and updates.
Source Code Link
Customer Segmentation Project:
Project Description:
The Customer Segmentation Project included comprehensive data preprocessing, RFM analysis, and the application of clustering and classification techniques. Employed modular coding practices for efficient development and deployed the project using Flask API for seamless accessibility.
Tool Stack: ML (Classification models), Python, Statistics, Excel, Flask API.
Source Code Link
E-learning Recommender System Project
Project Description:
The E-learning Recommender System Project encompassed the entire data science pipeline, from importing data to deploying a recommendation model. Imported data from a Postgres database and executed steps such as Data Preparation, Exploratory Data Analysis, Feature Engineering, and Text Preprocessing. Developed a content-based Recommendation Model and converted the project programming to modular coding for enhanced organization and maintenance. Deployed the final system using FastAPI for efficient access.
Tool Stack: Recommender System, SQL, Python, Statistics, Jupyter Notebook, FastAPI.
Data Science
Date of Birth: 1st January 1995
Languages Known: Kannada, English,Hindi
Nationality: Indian
Marital Status: Single
Gender: Male
Permanent Address: Bheemaraya colony Yeramarus Camp raichur-584135.
Place: Raichur