Overall 3+ years of experience in IT and Detail-oriented and results-driven ETL developer specializing in Databricks, Redshift, Postgres, and S3. Proficient in SQL and distributed processing frameworks. Proven ability to ensure data quality, optimize ETL processes, and contribute to the overall efficiency of data systems.
ETL Developer-
• I have expertise in building pipeline for data processing using spark. Worked in developing batch jobs(historical and incremental).
• Used Stonebranch as orchestration tool for job dependency, and scheduling,
• I have hands on experience on databases like Postgress, Redshift.
• Used Postgress for ABC entries (audit processing for tables).
ETL Tester-
• Worked in understanding the business requirements and validating if development happens in sync with the STM
(source target mappings) specified.
• Worked on SIT testing, prepared testcases to evaluate the development issues.
• Worked in extensive debugging of spark jobs and finding impact points in SQL queries leading to data quality issues.
• Ensured the architecture work for application meets the requirement and suggested changes to make it robust.
• Regarding testing with runs before and after data load ensured all moving parts of application are working in sync with
the standards.
• Big Data Masters Program by Trendy Tech
• AZ-900 Microsoft Azure Fundamentals Certificate
• DP-900 Microsoft Data Fundamentals Certificate
• DP-203 Azure Data Engineer Associate
• AWS_DVAC01 AWS Developer Associate
• Databricks Lakehouse Fundamentals Accreditation
Ergast API project
Covid-19 project