Experienced Data Engineer with 4+ years of experience in python,sql and AWS. Expertise in Spark, Delta Lake, Glue, Airflow.
Overview
3
3
years of professional experience
3
3
Certifications
Work History
Data/BI Engineer
Tata Consultancy Services (TCS)
10.2022 - Current
Designed Scalable Glue Data Pipelines for ingestion from CSV/Gsheet file coming in SFTP server or Gdrive location leveraging PySpark,S3 buckets,Iceberg tables and finally ingesting into Redshift
Subsequenly, worked on transforming them via dbt models,have successfully designed 40+ dbt models across different dbt projects and configured scheduling through apache airflow.
Acquired deeper understanding of Life Sciences and Healthcare domain
Business Analyst at Diligenta (TCS- UK Subsidiary), TATA CONSULTANCY SERVICES(TCS) PVT.LTDBusiness Analyst at Diligenta (TCS- UK Subsidiary), TATA CONSULTANCY SERVICES(TCS) PVT.LTD
Power BI Developer | BI & Analytics Team Lead at Tata Consultancy Services (TCS)Power BI Developer | BI & Analytics Team Lead at Tata Consultancy Services (TCS)