Arjun Chand
Data Engineer
Kolkata,WB
Summary
Skilled and solutions-oriented Data Engineer with over 8 years of experience in architecting and implementing scalable, high-performance data solutions across Azure and AWS cloud environments . Adept at designing robust ETL/ELT pipelines , orchestrating complex dataflows, and transforming raw data into actionable insights that power enterprise analytics and business intelligence.
Expert in Azure Data Factory, Datalake,Deltalake,Lakehouse, Azure Data Lake Storage Gen2, Databricks , and Azure Functions , with additional hands-on experience in AWS Glue, Amazon Redshift, and Lambda for hybrid or cloud-agnostic solutions.
Key Achievements:
- Improved data accessibility by 30% and reduced pipeline runtime by 25% by migrating legacy workflows to Azure Data Factory and Databricks .
- Enhanced query performance by 50% with optimized partitioning and schema modeling in Azure Synapse and Amazon Redshift .
- Reduced pipeline failure rates by 60% through automated monitoring and recovery using Azure Monitor , CloudWatch.
- Achieved 99.9% pipeline reliability through orchestration using ADF , Step Functions , and Lambda .
- Lowered processing costs by 35% by leveraging serverless architectures and tuning pipelines across both Azure and AWS.
Overview
14
14
years of professional experience
3
3
Languages
Work History
Azure Cloud Data Engineer
IBM,Client:Major Bank
05.2022 - Current
- Data transformation for credit card data using DBT and Databricks.
- Working with Azure services (ADF, Azure SQL, Azure functions, Lakehouse, Data Lake, Delta Lake, Lakehouse).
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
AWS Data Engineer/Software Python Developer
IBM,Client:Major Retail Company
04.2023 - 05.2024
- Data ingestion using AWS Event Bridge,EC2,EMR,S3,glue Lambda, and PostgreSQL, Dynamo db , AWS DMS,Python
- Reduced costs by automating manual processes using AWS Lambda functions.
- Optimized data processing by implementing AWS-based big data solutions.
Azure Data Engineer
IBM, Client: Major Insurance Company
05.2022 - 03.2023
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- .Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
- Designed scalable and maintainable data models to support business intelligence initiatives and reporting needs.
- Collaborated with cross-functional teams for seamless integration of data sources into the company''s data ecosystem.
Azure Cloud Data Engineer/ Sr. Data Engineer/ Data Engineer
Cognizant Japan/Cognizant
04.2016 - 05.2022
- Data Engineering with Python & Azure Data Factory, Azure functions.
- Data-driven data ingestion using ADF, AZURE-SQL, Python, PySpark.
- Data warehouse management using AWS Lambda, Step Functions, and Glue.
- Data ingestion using NiFi, Hive, and Spark.
- Asset data repository management using Spark, Scala, and Oracle DB.
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Migrated legacy systems to modern big-data technologies, improving performance and scalability while minimizing business disruption.
- .Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
Salesforce Developer
Resilinc
03.2015 - 02.2016
- End-to-end supply chain resiliency solution development.
Java Developer
Quickplay
08.2014 - 02.2015
- Multi-screen video distribution managed services.
Java Developer
Wipro
04.2011 - 08.2014
- Various projects in banking and media sectors.
Education
BTech - Computer Science And Engineering
Mallabhum Institute of Technology(WBUT)
West Bengal, India05-2010
Skills
Python
Scala
Java
Azure SQL,ADF,Synapse,ADLS,Blob Storage,Databricks,Synapse,Lakehouse,DevOps,PoweBI
PySpark
AWS Glue,Step Functions,EC2,EMR,S3,Lambda,step function,
Event Bridge
Pandas
NumPy
SQL,PostgreSQL,DB2
ELT/ETL
Data modelling
GenAI
Data modeling / warehousing
Data pipeline design
ETL development
SQL expertise
Data migration
Big data processing
Performance tuning
Data security
Spark framework
Real-time analytics
Data governance
Data curating
SQL and databases
DSA
Big data technologies
Problem-solving abilities
Analytical thinking
Attention to detail
Time management
Team collaboration
Multitasking Abilities
Decision-making
Time management abilities
Written communication
Effective communication
Critical thinking
Adaptability
Professionalism
Interpersonal skills
Teamwork and collaboration
Self motivation
Timeline
AWS Data Engineer/Software Python Developer
IBM,Client:Major Retail Company
04.2023 - 05.2024
Azure Cloud Data Engineer
IBM,Client:Major Bank
05.2022 - Current
Azure Data Engineer
IBM, Client: Major Insurance Company
05.2022 - 03.2023
Azure Cloud Data Engineer/ Sr. Data Engineer/ Data Engineer
Cognizant Japan/Cognizant
04.2016 - 05.2022
Salesforce Developer
Resilinc
03.2015 - 02.2016
Java Developer
Quickplay
08.2014 - 02.2015
Java Developer
Wipro
04.2011 - 08.2014
BTech - Computer Science And Engineering
Mallabhum Institute of Technology(WBUT)