Summary
Overview
Work History
Education
Skills
Certification
Work Availability
Timeline
Languages
Personal Information
Generic
Prabir Sahoo

Prabir Sahoo

Data Engineer
Bangalore

Summary

Seasoned Data Engineering professional with over 12+ years of experience in designing and implementing data-intensive applications, enterprise-grade data warehouses, and scalable data lake solutions. Expertise includes building robust ETL pipelines using modern technologies and tools across the Big Data Hadoop ecosystem (Hive, Apache Spark), and leveraging cloud platforms to optimize performance and scalability. Adept in using leading ETL tools and cloud services to drive business intelligence and analytics. Demonstrated ability to lead cross-functional teams, manage complex data projects, and deliver high-impact solutions aligned with business goals.

EXPERIENCE -HIGHLIGHTS

  • Solid understanding of Data Engineering Principles and best practices.
  • In depth understanding of Big Data Eco system & Spark Architecture.
  • Familiarity with building Simple GenAI use cases leveraging GenAI tools.
  • Extensive experience in various database technologies like RDBMS, SQL ,Oracle , NoSql, Hive, HBase , Cassandra & HDFS.
  • Hands on Experience in building Hive queries for data processing & Performance tuning of Hive SQL.
  • Exposure to cloud technologies like MS Azure,AWS & Google Cloud.
  • Exposure to various ETL & BI reporting tools like Informatica, SSIS etc.
  • Exposure to Snowflake and Databricks for data integration and analytics.
  • Strong experience with Unix/Shell scripting & Python scripting and exposure to Scheduling tools like Autosys, Automic and ControlM .
  • Experience in Data Modelling , ER & Dimensional Modelling etc..
  • Experience with CICD (Jenkins) & Version control (GIT).
  • Experience in Agile methodology Scrum / Kanban & Sprint.
  • Experience in managing and leading the team of 5-6 software engineers across global locations.
  • Worked with product managers in developing the strategy and road map to provide compelling capabilities.
  • Experience in stakeholder engagement, building strong relationship with business partners by collaborating globally with sponsors, users, and engineering colleagues across multiple divisions.

Overview

15
15
years of professional experience
3
3
Languages
1
1
Certificate

Work History

Senior Data Engineer(Sr. Associate Vice President)

Wells Fargo
09.2022 - Current
  • Led the design and development of TSDS (Strategic Data Store) for marketing and trade surveillance applications using the Big Data Hadoop platform.
  • Spearheaded end-to-end development, including SUNRISE activities to successfully launch the TSDS application from scratch.
  • Managed and mentored a high-performing Big Data engineering team, fostering a collaborative and delivery-focused work environment.
  • Successfully productionized the TSDS platform, enabling real-time data delivery to critical surveillance systems.

Assoc Mgr. Software Devl

IQVIA
12.2017 - 08.2022
  • Developed and optimized robust ETL pipelines leveraging Apache Spark and Scala, ensuring seamless data integration from internal and external sources.
  • Managed data ingestion processes on Amazon S3, orchestrating data from flat and parquet files into stage tables for efficient downstream processing.
  • Executed data mastering techniques for customer data loading into Reltio platform, enhancing data quality and accessibility.
  • Collaborated with cross-functional teams to extract and publish client reporting data from CDW Hive tables, aligning with business intelligence needs.
  • Led initiatives to improve data processing layers, including Stage, ETL, and publish fact tables, optimizing system performance.
  • Led an offshore development team, conducted root cause analysis (RCA) for production issues, and implemented timely fixes.
  • Maintained comprehensive design documentation, conducted code reviews, and mentored junior team members to build technical capacity

Software Engineer

Collabera
03.2017 - 11.2017
  • Managed the client's enterprise Data Warehouse for Reservations & Bookings, ensuring data availability, integrity, and timely reporting.
  • Designed and developed robust SSIS ETL pipeline, optimizing data extraction, transformation, and loading processes.
  • Identified and resolved ETL performance bottlenecks, implementing solutions to improve system efficiency and reliability.
  • Automated manual reporting tasks, significantly improving productivity and reducing operational overhead.
  • Monitored production systems and ensured consistent data availability for reporting applications.
  • Performed performance tuning of complex Oracle SQL queries and delivered innovative solutions to improve data processing speed.

PLSQL Developer(Assistant Manager)

Meena Agency Limited
01.2013 - 02.2017
  • Developed efficient stored procedures /Packages for seamless data retrieval and manipulation, increasing application response time. as per the requirement.
  • Contributed to successful project completion by adhering to strict deadlines and meeting client requirements.
  • Maintained database documentation for accurate record-keeping and easy reference for colleagues.
  • Streamlined data migration processes by developing SSIS ETL tools tailored to specific project requirements.
  • Automated tasks with the help of shell scripts, boosting team productivity.

Automation Program Engineer

TRL Krosaki Ltd.
07.2010 - 12.2012

Worked as Electronics and Automation program engineer for developing PLC and SCADA programming.

Education

B.Tech - Electronics & Telecommunication

BPUT
04.2001 -

Skills

Python and Scala programming

undefined

Certification

Google associate cloud engineer

Work Availability

monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse

Timeline

Google associate cloud engineer

12-2023

Senior Data Engineer(Sr. Associate Vice President)

Wells Fargo
09.2022 - Current

Assoc Mgr. Software Devl

IQVIA
12.2017 - 08.2022

Software Engineer

Collabera
03.2017 - 11.2017

PLSQL Developer(Assistant Manager)

Meena Agency Limited
01.2013 - 02.2017

Automation Program Engineer

TRL Krosaki Ltd.
07.2010 - 12.2012

B.Tech - Electronics & Telecommunication

BPUT
04.2001 -

Languages

English
Hindi
Odia

Personal Information

  • Father's Name: Pramod Kumar Sahoo
  • Date of Birth: 08/07/87
  • Nationality: Indian
  • Marital Status: Married
Prabir SahooData Engineer