Summary
Overview
Work History
Education
Skills
Personal Information
Awards
References
Timeline
Generic

SOURAV CHOWDHURY

PUNE

Summary

Accomplished Data Engineering Manager with over 14+ years of experience in architecting and managing large-scale data solutions. Expertise in AWS, Python, Spark, Postgres and Databricks with a strong background in data modeling, ETL processes, and database management. Proven ability to lead cross-functional teams in the development and implementation of data-driven strategies that support business objectives. Skilled in translating complex business needs into scalable data architectures, optimizing data workflows, and ensuring high data quality and security. Adept at fostering a culture of innovation, continuous improvement, and collaboration within engineering teams. Committed to driving efficiency, leveraging the latest technologies, and delivering actionable insights through advanced data analytics.

Overview

7
7
years of professional experience

Work History

Technical Manager

Xoriant Solutions
01.2018 - Current
  • Develop project plans, including timelines, milestones, and resource allocation, ensuring alignment with business goals
  • Engage with clients to understand their requirements, provide technical insights, and ensure their needs are met
  • Ensure the ongoing maintenance and stability of systems, including updates, patches, and improvements
  • Assist in troubleshooting complex technical issues and provide solutions to ensure project continuity
  • Host and moderate daily stand-up meetings to ensure team members are aligned and any roadblocks are identified and addressed promptly
  • Organize Sprint Review meetings where the team demonstrates the work completed during the Sprint and gathers feedback from stakeholders
  • Establish and maintain quality assurance processes to ensure the reliability and performance of the delivered solutions
  • Encourage a culture of continuous improvement by helping the team identify opportunities for enhancing productivity, quality, and team dynamics
  • Assist the Product Owner with managing the product backlog, including prioritization and refinement of backlog items
  • Oversee the execution of projects, monitor progress, and ensure that projects are delivered on time, within scope, and on budget
  • Conduct regular performance reviews, provide constructive feedback, and develop individual growth plans for team members.

Data Architect

Xoriant Solutions
03.2024 - 06.2024
  • Developed and maintained data collection systems and processes
  • Established data standards, policies, and best practices
  • Created a roadmap for data architecture evolution and improvements
  • Designed scalable, flexible, and optimized data models
  • Collaborated with stakeholders to gather requirements and validate data models
  • Ensured compliance with regulatory requirements and industry standards
  • Implemented data governance policies and procedures.

Technical Manager

Xoriant Solutions
06.2019 - 06.2023
  • Handled multiple applications across DevOps portfolio and worked as an individual contributor for the main billing application of the client
  • Worked in restructuring various ETL processes involved in billing to new tech stack involving Spark SQL and automating the whole process
  • Loaded data into Spark RDD and did memory data computation to generate the output response
  • Designed Extract, Transform, Load (ETL) processes to prepare financial reports using Python, and AWS Glue
  • Ensured quick analysis of large-scale data in Amazon S3 using Amazon Athena and PySpark
  • Developed CloudFormation Scripts for AWS Orchestration
  • Created a Python tool to check and compare data from Kafka topics and lag time between 2 sources of data
  • Optimized existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frames and Pair RDDs
  • Developed new changes as per business requirements in Scala and created the test scenarios
  • Handled large datasets using partitions, Spark in memory capabilities, broadcasts in Spark, effective and efficient Joins, Transformation and other during ingestion process itself
  • Gathered business requirement to determine feasibility and to convert them to technical tasks in the design document
  • Involved in building scalable distributed data lake system for Confidential real time and batch analytical needs
  • Ability to automate provisioning and configuration of cloud-based environments with configuration management tools, including Cloud Formation
  • Continued assuming responsibilities from different stakeholders, increased team cohesion, technical ability, and implementation of positive feedback.

Education

Certificate -

Oracle Certified Associate For The Oracle Platform (OCA)
Bhubhaneshwar
05.2008

Certificate -

ITIL 2011 Foundation Certificate in IT Service Management

Certificate -

Databricks Certified Data Engineer Associate
Databricks
06.2010

Bachelor Of Engineering -

IT Biju Pattnaik
06.2008

Skills

  • AWS
  • Spark
  • Python
  • Postgres
  • Project Management
  • Databricks

Personal Information

  • Date of Birth: 12/29/1984
  • Gender: Male
  • Nationality: India
  • Marital Status: Married

Awards

  • Received Titan Team Awards for excellent performance, Jan 2023
  • Received Titan Individual Award, Jun 2022
  • Received Star Individual Awards twice
  • Awarded Best Employee of the Month Award, TCS

References

Available on Request

Timeline

Data Architect

Xoriant Solutions
03.2024 - 06.2024

Technical Manager

Xoriant Solutions
06.2019 - 06.2023

Technical Manager

Xoriant Solutions
01.2018 - Current

Certificate -

Oracle Certified Associate For The Oracle Platform (OCA)

Certificate -

ITIL 2011 Foundation Certificate in IT Service Management

Certificate -

Databricks Certified Data Engineer Associate

Bachelor Of Engineering -

IT Biju Pattnaik

Similar Profiles

CREATE PROFILE
SOURAV CHOWDHURY