Prabir Sahoo

• Designed and developed TSDS (Strategic Data Store) for marketing and trade surveillance applications using Big Data Hadoop platform.
• Spearheaded end-to-end development, including SUNRISE, data ingestion, transformation, and storage pipelines, ensuring high scalability and reliability.
• Managed and mentored high-performing Big Data engineering team, promoting collaboration and focus on delivery.
• Productionized TSDS platform, facilitating real-time data delivery to critical surveillance systems.

• Developed and optimized robust data pipelines using Apache Spark and Scala for seamless integration of internal and external data sources.
• Managed data ingestion processes on Amazon S3, orchestrating flat and parquet files into stage tables.
• Executed data mastering techniques for loading customer data into Reltio platform, enhancing quality and accessibility.
• Collaborated with cross-functional teams to extract and publish client reporting data from CDW Hive tables.
• Led improvements in data processing layers, including Stage, ETL, and publish fact tables to optimize system performance.
• Directed offshore development team, performed root cause analysis for production issues, and implemented fixes.
• Maintained comprehensive design documentation, conducted code reviews, and mentored junior team members.

• Managed enterprise Data Warehouse, ensuring data availability, integrity, and timely reporting.
• Designed robust SSIS ETL pipeline to optimize extraction, transformation, and loading processes.
• Identified ETL performance bottlenecks and implemented solutions to enhance system efficiency.
• Automated manual reporting tasks, improving productivity and reducing operational overhead.
• Monitored production systems to maintain consistent data availability for reporting applications.
• Performed performance tuning of complex Oracle SQL queries, delivering solutions that accelerated data processing.

• Developed efficient stored procedures and packages to enhance data retrieval and application response time.
• Automated tasks using shell scripts to increase team productivity.
• Streamlined data migration by creating SSIS ETL tools for project-specific needs.
• Maintained comprehensive database documentation for accurate record-keeping and reference.
• Contributed to successful project completion by meeting strict deadlines and client requirements.

Worked as Electronics and Automation program engineer for developing PLC and SCADA programming.