Highly accomplished Big Data Engineer with 10.5 years of experience specializing in Big Data technologies, including PySpark, Python, Scala, and data pipelines. Proficient in designing and delivering end-to-end data processes, with a keen focus on performance tuning and optimization. Adept at managing complex batch processing workflows and driving efficiency improvements. Strong track record of success in implementing scalable solutions and delivering measurable business value. Recognized for exceptional leadership, strategic planning, and effective stakeholder communication.
Overview
11
11
years of professional experience
Work History
Development Lead - AVP
Citicorp Services India Private Limited
04.2023 - Current
Project Leadership and Management: Spearheaded key initiatives, including the migration of over 400 analysts from SAS to EAP, and managed deployment processes for critical banking systems. Orchestrated project planning, resource allocation, and timeline management, ensuring successful execution and alignment with organizational objectives.
Team Development and Empowerment: Led a team of six professionals, leveraging their diverse skill sets to maximize efficiency and productivity. Developed and implemented strategies for task allocation, fostering a collaborative environment conducive to innovation and growth.
Strategic Planning and Execution: Created comprehensive implementation plans and timelines for project delivery, prioritizing tasks based on organizational needs and resource availability. Invested additional hours in high-priority tasks to ensure timely completion and mitigate risks.
Team Administration and Development: Managed team leave planning, conducted year-end reviews, and provided constructive feedback to team members to drive performance improvement. Instituted reward and recognition programs to foster a culture of appreciation and motivation.
Stakeholder Engagement and Communication: Represented the team in monthly business review meetings with stakeholders and senior leadership, effectively communicating project progress, challenges, and achievements. Established strong relationships with key stakeholders to ensure alignment of project outcomes with business objectives.
Continuous Improvement and Innovation: Actively pursued opportunities for process optimization and innovation, particularly in the realm of big data migration and deployment processes. Implemented self-serve CI/CD pipelines to enhance efficiency and compliance with organizational standards.
Bigdata Lead - C11
Citicorp Services India Private Limited
11.2020 - 03.2023
Leading design and implementation of Digital Acquisition Reporting by reengineering and migrating process from SAS to Bigdata platform using Pyspark, remediating high risk EUC by automating complete process on bigdata platform.
Transitioning regression models for product marketing campaigns from SAS to Pyspark using Corridor Platform providing improved performance, model governance and code recalibration.
Migrating Profit and Loss simulators for credit card programs from SAS to Spark/Scala thereby eliminating need for outsourcing to third party and saving cost.
Leading and managing team of 3 people, continuously collaborating with US/India partners ensuring seamless project delivery.
Proactively collaborating with support teams to resolve any technical/infrastructure challenges in production.
Managing change requests, working through entire SDLC using GIT and Jenkins/RLM, ensuring smooth production deployment.
Actively involved in code review and recommending solutions for various challenging scenarios in implementation and performance.
Engaged in talent recruitment for data engineering roles.
Bigdata Engineer - BA4
Barclays Global Service Centre
10.2018 - 11.2020
Implemented solution called Travel Moment, in Scala/Spark using high volume Retail customer transaction data ,demographics and other reference data. Applied complex business logic to determine customer's travel score and to identify customers likelihood to travel in near future.
Collaborated with UK partners and facilitated production implementation of highly complex Scala/Spark logic for repartitioning retail transaction data (~4 TB) , critical for optimization of down stream process.
Trained and mentored new team members on technology and company processes.
Single handedly managed production releases including Git push, Jenkins setup , Tivoli job deployment and change management.
Bigdata Analyst - BA3
Barclays Global Service Centre
01.2016 - 09.2018
Created data pipelines to daily acquire data from different sources (teradata, mainframe) using sqoop/Informatica and store it into hive tables in SCD 2 format providing 360 degree view of Barclays merchant data.
Written data transformation logic in spark using Spark SQL.
Worked on SIT and UAT defect resolution.
Managed change request and supported L3 team during production deployment.
ETL Developer - BA2
Barclays Global Service Centre
10.2013 - 08.2016
Worked on FATCA External Reporting, implemented complex ETL workflows on informatica to identify FATCA classified customers, storing final data into teradata tables.
Acquired data from various sources including web, mainframe and salesforce, implemented data cleansing logic using DQ tools of Informatica and stored final data in Teradata SCD2 tables.
Education
Post Graduation Diploma - Advance Computing
ACTS - CDAC
Pune (MH)
07.2013
Bachelor Of Engineering - Information Technology
Bhilai Institute of Technology
Durg (C.G)
06.2012
Skills
Basic Python, Scala
Bigdata, Hadoop Ecosystem, HDFS
Apache Spark, PySpark, Hive, Impala
Shell Scripting, UNIX
SQL, SAS, Teradata, Oracle
Corridor Platform
Informatica
Jupyter Notebook, IntelliJ, Eclipse
Git, Bitbucket, Jenkins, AutoSys, Tivoli
Team Management
Project Planning
Accomplishments
Bronze Award Recipient (Citi - Feb 2024): Acknowledged for surpassing expectations and resolving Balcon campaign issue with exceptional dedication and problem-solving skills.
Gold Award Recipient (Citi - 2023): Recognized for outstanding leadership in driving EAP Adoption, demonstrating effective collaboration and strategic vision.
Rising Star Platinum Award (Citi - 2022): Honored with the highest accolade at Citi for significant contributions to the ATI team, showcasing innovation and excellence in performance.
Silver Award Recipient (Citi - 2021): Commended for impactful contributions to Turing Hub and Digital Acquisitions, displaying proficiency and commitment to project success.
Employee of the Month (Barclays): Acknowledged for delivering Travel Moments, demonstrating exemplary dedication and achievement in meeting project objectives.