Subhendu Bera
Senior Software Engineer
Bengaluru
Summary
Senior Software Engineer at Wells Fargo with over 11 years of experience developing and optimizing large-scale data pipelines and ETL frameworks in the financial industry. Proficient in Apache Spark, Apache Hive, Python, SQL, and cloud-agnostic architecture. Expertise in automating processes, integrating Large Language Model (LLM) functionality, and utilizing DevOps tools. Recognized for building stakeholder relationships, facilitating agile project delivery, and leading global teams collaboratively.
Overview
12
12
years of professional experience
21
21
years of post-secondary education
2
2
Certifications
Work History
Senior Software Engineer
Wells Fargo International Solutions Private LTD
05.2023 - Current
- Collaborated with global stakeholders to gather and translate business requirements into a scalable compliance monitoring architecture, supporting regulatory needs across 3+ regions.
- Led the design and implementation of a configuration-driven ETL framework using Pyspark, aligned with the Medallion Architecture to ensure clean separation of raw, curated, and business-ready data. Ingested and transformed data from 10+ heterogeneous sources (REST APIs, data lakes, RDBMS) into an Apache Hive warehouse, enabling self-service analytics via Dremio Virtual Datasets.
- Developed a custom SQL parsing engine to automate data lineage capture across the platform, enhancing governance and traceability, and saving ~1000 hours annually in manual documentation.
- Embedded advanced fuzzy matching algorithms (Levenshtein distance - token sort ratio) within the warehouse layer to flag policy violations related to sandbox environments, eliminating over 1800 hours/year of manual investigation.
- Integrated usage of Large Language Model (LLM) with application for higher efficiency.
- Modernized legacy ETL workflows by applying modular design principles and optimizing critical job runtimes by 10 - 15%, while achieving 75%+ unit test coverage to support CI/CD adoption and code quality assurance.
Senior Data Engineer
J P Morgan Services India Pvt. Ltd.
10.2018 - 05.2023
- Coordinated with product managers to architect an end-to-end compliance monitoring and alert model for international customers.
- Developed data ingestion pipeline, transformation and compliance model using utilizing different big data and cloud native framework such as - Apache Spark, Python, Object Store and Kubernetes.
- Spearheaded design and development of a high performance ETL environment (Informatica Power Center, Oracle, PL/SQL, Shell scrips).
- Streamlined Python and shell script code to implement ETL pipeline and end to end data load automations.
- Conceptualized data validation and cleaning framework to check different business requirements and provide quality data for analysis.
- Created test cases conforming to standard code scanning and more than 75% code coverage practice.
- Moved to 100 % development, integration and deployment using Agile methodologies and different DevOps tools.
- Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.
Associate - Business Intelligence
Cognizant Technology Solutions India Pvt. Ltd.
08.2013 - 10.2018
- Architected ETL pipeline (Informatica Power Center, Oracle, PL/SQL, Shell Scripts) to populate data warehouse.
- Expertise in data analysis and data modelling.
- Designed PL/SQL package to feed data to and from web-methods that meets 3 sec SLA.
- Conceptualized python automation scripts that reduced manual interventions by 50 %.
- Untwisted and amplified shell scripts to maintain job dependency and trigger ETL jobs.
- Experience in SIT/UAT/Post-production support and defect fixing.
- Lead an off-shore team of 5 developers.
Education
Master of Science - Computer Science
Banaras Hindu University
Varanasi, India 04.2001 - 01.2013
Bachelor of Science - Computer Science
University of Calcutta
Kolkata, India 04.2001 - 01.2011
Skills
Apache Spark proficiency
Certification
AWS Solutions Architect - Associate
Work Availability
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Timeline
Senior Software Engineer
Wells Fargo International Solutions Private LTD
05.2023 - Current
Senior Data Engineer
J P Morgan Services India Pvt. Ltd.
10.2018 - 05.2023
Associate - Business Intelligence
Cognizant Technology Solutions India Pvt. Ltd.
08.2013 - 10.2018
Master of Science - Computer Science
Banaras Hindu University
04.2001 - 01.2013
Bachelor of Science - Computer Science
University of Calcutta
04.2001 - 01.2011
Similar Profiles
Mayank OberoiMayank Oberoi
Financial Accounting Associate/ Alteryx SME at Wells Fargo International Solutions Private LTD (Wells Fargo)Financial Accounting Associate/ Alteryx SME at Wells Fargo International Solutions Private LTD (Wells Fargo)
Thomas Subin AlexThomas Subin Alex
Vice President, Lead Control Management Officer at Wells Fargo International Solutions Private LTDVice President, Lead Control Management Officer at Wells Fargo International Solutions Private LTD
DIVYADARSSINI R KDIVYADARSSINI R K
Senior Associate Vice President at Wells Fargo International Solutions Private LimitedSenior Associate Vice President at Wells Fargo International Solutions Private Limited
Avinash SubramanianAvinash Subramanian
Regional Lead- Treasury at Fluence BESS India Pvt LTDRegional Lead- Treasury at Fluence BESS India Pvt LTD
Shaik SadiqShaik Sadiq
Senior DevOps Engineer at Hexaware Technologies LimitedSenior DevOps Engineer at Hexaware Technologies Limited