Data Engineer with expertise in PySpark, SQL, Databricks, and Azure Data Factory, specializing in building scalable data pipelines and automating workflows. Experienced in backend development with Django, API integrations, and cloud-based data processing.
Programming & Scripting:
Python (PySpark, Pandas), SQL, Java, C, C
Data Engineering & Cloud Platforms:
Azure Data Factory (ADF), Azure Databricks (ADB), Azure Data Lake Storage (ADLS), Apache Spark, Spark SQL, Delta Lake
Web Development:
Django, Angular, HTML, CSS
Data Visualization:
Power BI
Other Tools & Technologies:
Unity 3D, Natural Language Processing (NLP), Generative AI (RAG - Retrieval Augmented Generation), Simpel Framework