Kishor Bhilare
Big Data Engineer
Pune
Summary
Responsive expert with over 3.5 years of experience in monitoring database performance, troubleshooting issues, and optimizing database environments. Possesses strong analytical skills, excellent problem-solving abilities, and a deep understanding of database technologies and systems. Equally confident working independently and collaboratively, utilizing excellent communication skills as needed.
Overview
3
3
years of professional experience
3
3
years of post-secondary education
2
2
Certifications
Work History
Cloud Data Engineer
Mathco
Pune
04.2022 - Current
- Project: Identity Resolution/EXT_IR/Customer360 Platform
- Duration: April 2023 - Present
- Designation: Data Engineer
- Overview:
- Implemented end-to-end data pipelines using Jenkins and Databricks for multiple client data sources.
- Role and Responsibilities:
- Analyzed customer requirements to prepare data flow mappings and transformations.
- Developed and enhanced data ingestion and analysis processes.
- Collaborated on understanding upstream data sources and business cases.
- Created end-to-end pipelines in Databricks using Jenkins CI/CD.
- Built robust data pipelines to automate data flow into IR/EXT_IR/C360.
- Created and scheduled master workflows to trigger all related streams.
- Environment:
- PySpark, Databricks, SparkSQL, Python, SQL, JIRA, GitHub, Jenkins, PyCharm.
- Project: Supply Chain
- Duration: April 2022 - April 2023
- Designation: Data Engineer
- Overview:
- Focused on cleaning and transforming data from various sources, building pipelines, and ensuring data quality.
- Role and Responsibilities:
- Analyzed customer requirements and mapped data flows for transformation and fixes.
- Developed, enhanced, and supported data ingestion and analysis processes.
- Collaborated on understanding upstream data sources and business cases.
- Created workflows for loading large datasets.
- Managed and reviewed GitHub repositories.
- Environment:
- Azure Storage Container, PySpark, Databricks, Jenkins, PyCharm, GitHub.
Analyst
Spectrum Consultant
Pune
06.2021 - 01.2022
- Organization: Spectrum Consultants
Project: Dist PnL
Duration: June 2021 - January 2022
Designation: Analyst
Overview:
Designed data flow and model for migrating tables between databases, successfully validating and migrating client data.
Role and Responsibilities:
Created data flow and model for table migration.
Developed SparkSQL jobs to ingest data into new databases.
Designed ADF pipelines for orchestration.
Environment:
Snowflake, SQL, Spark SQL, ADF, Data Modeler.
Education
Bachelor of Engineering -
Savitribai Phule Pune University
Pune 07.2016 - 07.2019
Skills
Big Data Technologies: Spark, Hive, Hadoop, Map Reduce
Cloud Technologies: AZURE (Databricks, ADF, Azure Storage, Azure key vault, ADF, Azure DevOps)
AWS (EC2,RDS, S3, EMR, EMR)
Programming Language: Python, SQL, PySparkk
Database: MySQL, SQL Server
Experienced In:Data Pipeline Design, ETL development, Data Migration
Languages: English, Hindi, Marathi
Certification
• Azure Databricks and Spark for Data Egnieers
Awards
- Speed Value Award - TheMathCompany 15thMarch 2024
- Appreciation Award - TheMathCompany 2nd January 2023
Timeline
• Databricks Certified Associate Developer for Apache Spark 3.0
02-2024
• Azure Databricks and Spark for Data Egnieers
02-2023
Cloud Data Engineer
Mathco
04.2022 - Current
Analyst
Spectrum Consultant
06.2021 - 01.2022
Bachelor of Engineering -
Savitribai Phule Pune University
07.2016 - 07.2019
Similar Profiles
Chhavi ChawlaChhavi Chawla
Manager Data Science at MathcoManager Data Science at Mathco
Roshni JainRoshni Jain
Senior Associate at MathcoSenior Associate at Mathco
Rahul RoshanRahul Roshan
Senior Data Scientist at MathCoSenior Data Scientist at MathCo