Over 2+ years of experience in Data Engineering , ETL processes , and Business Intelligence , with expertise in tools like Azure Synapse , Power BI , and Microsoft SQL Server . Hands-on experience in designing and automating data pipelines using Azure Data Factory and processing large-scale data with PySpark and Hive . Skilled in writing complex SQL queries , optimizing PySpark code , and delivering actionable insights through Power BI dashboards . Proven ability to collaborate with stakeholders to gather requirements, deliver tailored solutions, and manage databases effectively using Microsoft SQL Server . Strong proficiency in ETL pipeline design , data transformation , and performance optimization, ensuring alignment with business needs. Experienced in Unix scripting , performance monitoring , and troubleshooting PySpark jobs to ensure seamless operations.
Apache Spark
undefined