Work Preference
Summary
Overview
Work History
Education
Skills
Languages
Certification
Accomplishments
Timeline
Generic
Open To Work

Arnab Desarkar

Data Engineer and ETL Lead
Howrah

Work Preference

Job Search Status

Open to work
Desired start date: Open to discussion

Desired Job Title

Azure Data EngineerETL Lead DeveloperInformatica and PL/SQL DeveloperInformatica DeveloperL1 Technical Support Engineer

Work Type

Full Time

Location Preference

On-SiteRemoteHybrid
Location: Howrah, INKolkata, WB
Open to relocation: Yes

Summary

Seasoned Data Engineer and Technical Project Lead with over 12 years of experience in Databricks, SQL and Informatica PowerCenter. Specializes in ETL design and SQL programming, leading migration projects that enhance performance. Knowledgeable in the application development life cycle, focusing on automation to reduce manual tasks.

Overview

13
13
years of professional experience
1
1
Certification

Work History

Azure Data Engineer

Cognizant Technology Solutions
Kolkata
05.2024 - Current
  • Led migration project from Informatica PowerCenter to Azure Databricks, transforming all ETL jobs into Databricks pipelines.
  • Utilized Azure Data Factory for batch ingestion of source data from VPASOne, storing it in Delta table within Databricks metastore.
  • Applied various transformations on source batch data to load into silver and gold layers, implementing SCD Type-2 following Medallion architecture.
  • Enhanced job performance through tuning strategies like broadcast join and salting methods, optimizing data processing efficiency.
  • Worked with structured (csv) and semi-structured (JSON) files as a part of the outbound process
  • Developed technical documentation for workflows and processes, facilitating team knowledge sharing and onboarding.
  • Established task restart mechanism in workflow jobs, ensuring completed tasks do not rerun after job failures.
  • Managed orchestration of Databricks workflow jobs via CA Workload Automation tool for improved efficiency.
  • Using GitHub and Jenkins for components migration from lower to higher environments at the time of code deployments

ETL Lead Developer

Cognizant Technology Solutions
Kolkata
08.2019 - 04.2024
  • Led 6 developers in achieving project objectives through enhanced collaboration and communication.
  • Built ETL mappings for replication, integration, and outbound processes.
  • Fine-tuned code to enhance performance and efficiency.
  • Conducted end-to-end testing in alignment with business requirements.
  • Resolved defects identified by quality assurance (QA) team based on priority.
  • Minimized go-live risk factors, ensuring smooth execution and successful project delivery.
  • Recommended process improvements that streamlined workflows and enhanced team efficiency.
  • Managed code migration across environments utilizing GitHub and TeamCity.

Informatica and PL/SQL Developer

Cognizant Technology Solutions
Kolkata
10.2015 - 07.2019
  • Developed stored procedures for inbound process, enabling semi-real-time data integration from services.
  • Building ETL mapping for Outbound process
  • Fine tuning of existing codes to improve performance
  • Optimized database performance through indexing and query tuning.
  • Ensured data integrity through implementation of validation checks and procedures.
  • Participated in code reviews to ensure quality and compliance standards.
  • Developed stored procedures, functions and triggers to support application requirements.
  • Conducted end-to-end testing to validate business requirements.
  • Understanding defects raised by Quality Assurance (QA) team and resolving them in order of priority.
  • Executed code migrations between development, testing, and staging environments using GitHub.
  • Optimized SQL queries and stored procedures, significantly reducing execution time and enhancing application performance.

Informatica Developer

Cognizant Technology Solutions
Kolkata
02.2015 - 09.2015
  • Developed ETL processes using Informatica PowerCenter to streamline data integration for multiple projects.
  • Analyzed requirements and interpreted UNIX scripts, SQL procedures, and Oracle queries to ensure precise logic implementation.
  • Fine-tuned Oracle code to enhance performance metrics.
  • Updated Informatica code based on user acceptance testing feedback, successfully delivering enhancements for UAT.
  • Resolved QA testing defects based on priority to ensure quality assurance.
  • Conducted comprehensive end-to-end testing in line with business requirements.
  • Managed migration to staging environment from development for testing prior to release.

L1 Technical Support Engineer

Cognizant Technology Solutions
Chennai
05.2013 - 01.2015
  • Monitored production environment jobs, ensuring optimal performance and reliability.
  • Addressed job failures by diagnosing issues and implementing solutions swiftly.
  • Executed SLA job for customer Argus ID card generation, ensuring timely delivery.
  • Analyzed SLA job metrics to identify trends and enhance service delivery.
  • Streamlined manual job processes by automating tasks via Unix crontab, improving efficiency.
  • Handled ticket triaging to streamline customer inquiry resolutions.
  • Managed three applications with 706 jobs and around 14,000 sessions running smoothly.
  • Resynced member details from source systems to RDS, feeding into IBOR system.

Education

Master of Computer Applications - Computer Science

B. P. Poddar Institute of Management & Technology
Kolkata
07-2012

Bachelor of Science - Computer Science Honors

Sree Agrasain College
Howrah
07-2009

Higher Secondary Examination - Computer Science

Sun Rise (Eng.Med) School
Howrah
04-2006

Secondary Examination - Computer

Sun Rise (Eng.Med) School
Howrah
04-2004

Skills

  • Azure Databricks
  • Azure Data Factory (Basics)
  • ETL design
  • SQL and PL/SQL programming
  • Python programming
  • Performance tuning
  • Unix shell scripting
  • Problem solving
  • Project management
  • Team collaboration

Languages

English
Proficient (C2)
C2
Bengali
Native
Native
Hindi
Proficient (C2)
C2

Certification

  • Databricks Certified Data Engineer Associate
  • Python (PCEP-30-02) certified

Accomplishments

  • Appreciate for automating a tool “DB2 to SQLMI” converter (python based) – that will export Informatica XMLS, read all the SQL queries, convert them to SQLMI syntax, write the updated SQL in XML and import back the XML in the repository. This saved around $90,000 Client Hard Dollar.
  • Appreciated for developing “CAW Event Automation Tool” in Python in the year 2025 – which saved the manual effort of changing and uploading thousands of XML files.
  • Appreciated for developing “Informatica Code Generator Tool” in Shell Script in the year 2023 which saved Client Hard Dollar of $25,000 and it got selected in Cognizant Innovation.
  • Certified by Cognizant for “Outstanding Performance” in the year 2017-2018
  • Received “Einstein Award” from Cognizant for 7 Shell Scripts Innovation to automate Production Support jobs in the year 2014-2015
  • Winner of “Tech Storm 2.0 & 2.1” (C++ programming competition) in the year 2010 and 2011 respectively

Timeline

Azure Data Engineer

Cognizant Technology Solutions
05.2024 - Current

ETL Lead Developer

Cognizant Technology Solutions
08.2019 - 04.2024

Informatica and PL/SQL Developer

Cognizant Technology Solutions
10.2015 - 07.2019

Informatica Developer

Cognizant Technology Solutions
02.2015 - 09.2015

L1 Technical Support Engineer

Cognizant Technology Solutions
05.2013 - 01.2015

Master of Computer Applications - Computer Science

B. P. Poddar Institute of Management & Technology

Bachelor of Science - Computer Science Honors

Sree Agrasain College

Higher Secondary Examination - Computer Science

Sun Rise (Eng.Med) School

Secondary Examination - Computer

Sun Rise (Eng.Med) School

Similar Profiles

CREATE PROFILE
Arnab DesarkarData Engineer and ETL Lead