Debojyoty Goswami
Serampore
Summary
Results-driven Data Engineer with expertise in PySpark, SQL, Python, and AWS services. Proven track record of ingesting and transforming large datasets to meet business requirements, while optimizing data workflows for enhanced processing efficiency. Strong analytical skills and detailed-oriented approach contribute to resolving data-related issues within existing codebases. Committed to leveraging technical skills to drive innovative data solutions in a forward-thinking organization.
Overview
4
4
years of professional experience
Work History
Data Engineer
Tata Consultancy Service
Kolkata
04.2021 - Current
Core Responsibility
- Design, develop, and maintain ETL/ELT pipelines.
- Build and optimize data pipelines and workflows.
- Managed ingestion of information from various sources including CDOCS,PostgreSQL,s3 bucket, salesforce.
- Work with big data technologies (Spark, Databricks, Hadoop).
- Design and optimize data models and schemas.
- Monitor and troubleshoot data pipeline performance.
Achievement and Impact
- Increased Efficiency: Reduced data processing time by 30% by optimizing ETL pipelines and cluster configuration.
- Improved Data Integrity: Achieved 100% data consistency by implementing robust data validation checks.
- Cost Optimization: Lowered cluster costs by 15% through resource optimization and workload balancing.
- Enhanced Query Performance: Improved query response time by 20% by optimizing data models and partitioning strategies.
- Scalability: Developed scalable pipelines capable of processing high-volume data efficiently.
Education
Bachelor of Technology - Electronics And Communications Engineering
Academy of Technology(AOT)
Adisaptagram06-2020
Higher Secondary School Education - Science
Bholananda National Vidyalaya
Barrackpore04-2016
Secondary School Education -
Gospel Home School
Rishra06-2014
Skills
- Pyspark Analysis Expertise
- Python Programming
- Proficient in SQL
- Experience with Databricks
- Data Management
- ETL Process Development
- Data pipeline development and optimization
- Data Warehouse Management
Languages
Bengali
First Language
English
Proficient (C2)
C2
Hindi
Proficient (C2)
C2
Timeline
Data Engineer
Tata Consultancy Service
04.2021 - Current
Bachelor of Technology - Electronics And Communications Engineering
Academy of Technology(AOT)
Higher Secondary School Education - Science
Bholananda National Vidyalaya
Secondary School Education -
Gospel Home School
Similar Profiles
Rekha BadgujarRekha Badgujar
Senior Pharmacovigilance Specialist at Tata Consultancy ServiceSenior Pharmacovigilance Specialist at Tata Consultancy Service
Habtamu DestaHabtamu Desta
Cyber Security Analyst at TATA Consultancy ServiceCyber Security Analyst at TATA Consultancy Service
Alvaro MartinezAlvaro Martinez
SQL Delphi Developer at Tata Consultancy ServiceSQL Delphi Developer at Tata Consultancy Service