Arjun Chand
Data Engineer
Kolkata,WB
Summary
Skilled and solutions-oriented Data Engineer with over 8 years of experience in architecting and implementing scalable, high-performance data solutions across Azure and AWS cloud environments . Adept at designing robust ETL/ELT pipelines , orchestrating complex dataflows, and transforming raw data into actionable insights that power enterprise analytics and business intelligence.
Expert in Azure Data Factory, Datalake,Deltalake,Lakehouse, Azure Data Lake Storage Gen2, Databricks , and Azure Functions , with additional hands-on experience in AWS Glue, Amazon Redshift, and Lambda for hybrid or cloud-agnostic solutions.
Key Achievements:
- Improved data accessibility by 30% and reduced pipeline runtime by 25% by migrating legacy workflows to Azure Data Factory and Databricks .
- Enhanced query performance by 50% with optimized partitioning and schema modeling in Azure Synapse and Amazon Redshift .
- Reduced pipeline failure rates by 60% through automated monitoring and recovery using Azure Monitor , CloudWatch.
- Achieved 99.9% pipeline reliability through orchestration using ADF , Step Functions , and Lambda .
- Lowered processing costs by 35% by leveraging serverless architectures and tuning pipelines across both Azure and AWS.
Overview
14
14
years of professional experience
3
3
Languages
Work History
Azure Cloud Data Engineer
IBM,Client:Major Bank
05.2022 - Current
- Data transformation for credit card data using DBT and Databricks.
- Working with Azure services (ADF, Azure SQL, Azure functions, Lakehouse, Data Lake, Delta Lake, Lakehouse).
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
AWS Data Engineer/Software Python Developer
IBM,Client:Major Retail Company
04.2023 - 05.2024
- Data ingestion using AWS Event Bridge,EC2,EMR,S3,glue Lambda, and PostgreSQL, Dynamo db , AWS DMS,Python
- Reduced costs by automating manual processes using AWS Lambda functions.
- Optimized data processing by implementing AWS-based big data solutions.
Azure Data Engineer
IBM, Client: Major Insurance Company
05.2022 - 03.2023
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- .Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
- Designed scalable and maintainable data models to support business intelligence initiatives and reporting needs.
- Collaborated with cross-functional teams for seamless integration of data sources into the company''s data ecosystem.
Azure Cloud Data Engineer/ Sr. Data Engineer/ Data Engineer
Cognizant Japan/Cognizant
04.2016 - 05.2022
- Data Engineering with Python & Azure Data Factory, Azure functions.
- Data-driven data ingestion using ADF, AZURE-SQL, Python, PySpark.
- Data warehouse management using AWS Lambda, Step Functions, and Glue.
- Data ingestion using NiFi, Hive, and Spark.
- Asset data repository management using Spark, Scala, and Oracle DB.
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Migrated legacy systems to modern big-data technologies, improving performance and scalability while minimizing business disruption.
- .Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
Salesforce Developer
Resilinc
03.2015 - 02.2016
- End-to-end supply chain resiliency solution development.
Java Developer
Quickplay
08.2014 - 02.2015
- Multi-screen video distribution managed services.
Java Developer
Wipro
04.2011 - 08.2014
- Various projects in banking and media sectors.
Education
BTech - Computer Science And Engineering
Mallabhum Institute of Technology(WBUT)
West Bengal, India05-2010
Skills
Python
Timeline
AWS Data Engineer/Software Python Developer
IBM,Client:Major Retail Company
04.2023 - 05.2024
Azure Cloud Data Engineer
IBM,Client:Major Bank
05.2022 - Current
Azure Data Engineer
IBM, Client: Major Insurance Company
05.2022 - 03.2023
Azure Cloud Data Engineer/ Sr. Data Engineer/ Data Engineer
Cognizant Japan/Cognizant
04.2016 - 05.2022
Salesforce Developer
Resilinc
03.2015 - 02.2016
Java Developer
Quickplay
08.2014 - 02.2015
Java Developer
Wipro
04.2011 - 08.2014
BTech - Computer Science And Engineering
Mallabhum Institute of Technology(WBUT)
Similar Profiles
PEEYUSH ANANDPEEYUSH ANAND
Senior Software Engineer at IBM [Client - Danske Bank]Senior Software Engineer at IBM [Client - Danske Bank]
HARISH BABU VALMIKIHARISH BABU VALMIKI
Application Support Lead at Bank of Montreal, IBM CanadaApplication Support Lead at Bank of Montreal, IBM Canada
Crislaine Dario Dias de OliveiraCrislaine Dario Dias de Oliveira
RRM - Region Resource Manager at IBM/PROXXI TECNOLOGIA - EMPRESA IBMRRM - Region Resource Manager at IBM/PROXXI TECNOLOGIA - EMPRESA IBM
Veer J KamdarVeer J Kamdar
Technical Support Executive at TeleperformanceTechnical Support Executive at Teleperformance
ARIJIT PALARIJIT PAL
Intern at Canara BankIntern at Canara Bank