
Detail-oriented data engineer with nearly 4.5 years of experience leveraging advanced technologies and tools to enhance organizational success in data management and analysis. Specializes in optimizing data processing and quality assurance processes, resulting in increased efficiency, reduced errors, and improved regulatory compliance. Demonstrated expertise in managing data loading tasks on Databricks, a leading cloud-based data processing platform, while effectively organizing and overseeing complex data workflows using Airflow to ensure seamless execution and timely delivery. Proven ability to evaluate the efficacy and accuracy of new and existing data sources and analysis methods, driving continuous improvement in data-driven decision-making.
Detail-oriented, organized, and meticulous employee. Works at fast pace to meet tight deadlines. Enthusiastic team player ready to contribute to company success.
Programming Languages: Python, MySQL, Pyspark
Frameworks: Apache Spark, DBT, Airflow
Data Transformation and Modeling
ETL (Extract, Transform, Load) Processes
Database Management (SQL, NoSQL)
Cloud Platforms (AWS, Azure)
Data Pipeline Orchestration (Airflow)
Scripting and Programming Languages (Python, Scala)
Problem-solving and Troubleshooting Skills
Communication and Collaboration Skills
Snow Flake
Programming
Object-oriented programming