Chandan Mehta
Pune
Summary
Results-driven Data Engineer with over 6+ years of expertise in Python and SQL, honed at Rockwell Automation. Successfully developed scalable data pipelines and optimized ETL processes, enhancing analytics capabilities. Proficient in Databricks and Azure Data Factory, demonstrating strong problem-solving skills and a commitment to data integrity. Passionate about leveraging big data for impactful insights.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Data Engineer
ROCKWELL AUTOMATION
Pune
05.2023 - Current
- Developed comprehensive data pipeline architecture utilizing Databricks notebooks with S2L, L2C, and C2P stages.
- Executed jobs triggering ADF data pipelines for efficient data processing.
- Stored files in ADLS Gen2 for scalable data storage solutions.
- Cataloged data within Databricks for streamlined access and management.
- Created tables and views in Databricks catalog to enhance data organization.
- Built and tested models in Tabular Editor using SQL and DAX Studio for accuracy.
- Generated reports in Power BI leveraging robust analytics from developed models.
Data Engineer
CGI
Pune
04.2022 - 05.2023
- Data Ingestion: Utilized a Scala framework to efficiently process transactional banking data with Apache Spark.
- Implemented robust ETL pipelines to ensure data accuracy and integrity, enabling real-time analytics and reporting.
- Designed, constructed, and maintained scalable data pipelines for data ingestion, cleaning, and processing using Python and SQL.
- Conducted rigorous testing and validation of data pipelines to ensure accuracy and completeness of data.
- Monitored data systems performance, identifying bottlenecks and implementing solutions to maintain system efficiency.
DWH/BI DEVELOPER
AMDOCS
Pune
09.2018 - 04.2022
- Managed source data ingestion via NiFi Hadoop framework for on-premises and Azure cloud environments.
- Developed efficient ETL processes, enhancing data flow and integration for analytics scalability.
- Supported high-performance data analytics through optimized data ingestion strategies.
Education
Bachelor of Computer Engineering -
All India Shree Shivaji Memorial Society
Pune01.2018
Skills
- Programming languages: Python and SQL
- Data processing tools: Databricks, PySpark, and Hadoop
- ETL solutions and integration
- Cloud services: Azure Data Factory and Data Lake
- Job scheduling with Control-M
- Data modeling techniques
- Big data analytics
- Reporting tools: Power BI and DAX
- Version control with Git
- Project management with Jira and Confluence
- IT service management with ServiceNow
Accomplishments
- Finalist of AQE RED, 2021, Live project to trigger automation via chatbot 'Optimus' in Amdocs.
- Winner of Avishkar Tools 2.0, 2020, Live Project to manage tools Based on Django in Amdocs.
- Finalist of Avishkar Nexgen, 2019, Multiple Card Management System in Amdocs.
Certification
- Microsoft Certified: Azure Fundamentals
- Databricks Certified Data Engineer Associate
- Databricks Certified Data Engineer Professional
Timeline
Data Engineer
ROCKWELL AUTOMATION
05.2023 - Current
Data Engineer
CGI
04.2022 - 05.2023
DWH/BI DEVELOPER
AMDOCS
09.2018 - 04.2022
Bachelor of Computer Engineering -
All India Shree Shivaji Memorial Society
Similar Profiles
Ankur GadadeAnkur Gadade
Senior Project Coordinator at Rockwell AutomationSenior Project Coordinator at Rockwell Automation
Rodney Dale CaseyRodney Dale Casey
E and I Tech at Rockwell AutomationE and I Tech at Rockwell Automation
Deepikashree RDeepikashree R
Component Engineer at Rockwell AutomationComponent Engineer at Rockwell Automation