Om Prakash
Noida
Summary
Experienced data engineering leader with over a decade of expertise in constructing and enhancing extensive batch and streaming data pipelines on Azure, leveraging tools like Spark, Flink, and Databricks. Demonstrated track record of improving operational efficiency, facilitating data-informed decision-making processes, and guiding interdisciplinary teams within the capital markets and banking sectors.
Serving Notice Period | Available for Immediate Joining
Overview
11
11
years of professional experience
3
3
Certification
Work History
Associate Manager - Technology
Iris Software | Client: RBC Capital Markets
03.2021 - Current
- Designed and deployed scalable batch/streaming pipelines (PySpark, Flink, Scala) processing multi-terabyte datasets daily.
- Migrated 80+ on-prem complex workflows to Azure Databricks, reducing infrastructure costs and streamlining deployments with Docker/Kubernetes.
- Cut job runtimes by 30% through performance tuning, enhancing downstream data reliability.
- Led an 8-member offshore team; partnered with product stakeholders to deliver high-priority data features.
- Conducted internal training sessions on modern data architecture best practices.
IT Analyst
Tata Consultancy Services | Client: PNC Bank
11.2018 - 03.2021
- Enhanced PII protection framework, enabling tokenization across multiple environments using PySpark.
- Automated processing for over 2,000 tables, reducing completion times by 60% using Python and PySpark.
- Owned release and deployment planning, ensuring zero-impact rollouts.
Senior System Engineer
Infosys Ltd. | Clients: Suntrust Bank, Aetna
01.2015 - 11.2018
- Developed Spark and Hive scripts for structured and unstructured data analytics.
- Ingested and transformed data into Hive for business intelligence use cases.
- Built XQuery modules in MarkLogic for advanced XML data processing.
Education
B.Tech. - E.C.E.
Academy of Technology
W.B.U.T.01.2014
Skills
- PySpark
- Python
- Scala
- Azure- ADF, Databricks
- Flink
- GenAI- GitHub Copilot
- Hive
- Hadoop
- SQL
- Airflow
- Jenkins
- Docker & Kubernetes
Certification
- Databricks Certified: Data Engineer Associate, Lakehouse Fundamentals, 2024
- Microsoft Certified: Azure Fundamentals (AZ900), Azure Data Fundamentals (DP900), 2024
Timeline
Associate Manager - Technology
Iris Software | Client: RBC Capital Markets
03.2021 - Current
IT Analyst
Tata Consultancy Services | Client: PNC Bank
11.2018 - 03.2021
Senior System Engineer
Infosys Ltd. | Clients: Suntrust Bank, Aetna
01.2015 - 11.2018
B.Tech. - E.C.E.
Academy of Technology
Similar Profiles
HAMZA REHMANHAMZA REHMAN
Sr Manager - Client & Account Enablements at RBC Capital Markets - Business and Client ServicesSr Manager - Client & Account Enablements at RBC Capital Markets - Business and Client Services
Alexandra MarinoAlexandra Marino
Vice President, Program Management at RBC Capital MarketsVice President, Program Management at RBC Capital Markets
Jason LiJason Li
Manager, Product Control at RBC Capital MarketsManager, Product Control at RBC Capital Markets
Richa SharmaRicha Sharma
Deputy Manager at Optum Global SolutionsDeputy Manager at Optum Global Solutions
DIVJOT SINGHDIVJOT SINGH
Software Engineer II at MicrosoftSoftware Engineer II at Microsoft