Soumyajit Mitra
Bangalore
Summary
Results-driven data engineering and software development professional with over 11 years of experience in the software industry, specializing in software design, analysis, and implementation. Skilled in end-to-end solution delivery, including requirements gathering, prototyping, interface development, testing, deployment, and support.
Proficient in scripting languages such as Python and SQL, with strong expertise in cloud platforms, relational and cloud-native databases, and ETL pipeline design and development. Well-versed in data warehousing concepts, performance tuning, and migrating on-premise data systems to cloud environments. Demonstrated ability to architect scalable and maintainable data solutions across diverse business domains.
Overview
12
12
years of professional experience
Work History
Staff Software Engineer
BlackHawk Network
Bangalore
07.2024 - Current
- Designed and developed Python-based automation frameworks:
1. Report Bursting POC: Automatically generate and distribute reports based on dynamic query results and scheduling logic.
2. Calendar Automation: Custom scheduling system for data pipelines and reporting workflows. - Migrated critical ETL jobs and datasets from on-premises systems to AWS cloud infrastructure.
- Developed and maintained Matillion ETL jobs to support transformation pipelines.
- Collaborated with stakeholders to prototype and evaluate a Snowflake POC for cloud-native analytics and scalable storage.
- Participated in performance tuning, data validation, and job orchestration for smooth transition to cloud environments.
Senior Staff Data Engineer
Altimetrik
Bangalore
02.2022 - 06.2024
- Migrated complex ETL pipelines from IBM DataStage to Matillion, streamlining job orchestration and improving maintainability.
- Re-engineered data workflows by transitioning from on-premises Netezza databases to AWS Redshift, improving performance and scalability.
- Collaborated with stakeholders to understand technical requirements and provided regular updates on project progress, blockers, and deliverables.
- Utilized AWS S3 for intermediate data storage and staging during data migration and transformation processes.
- Developed Python scripts for ETL automation, metadata validation, and custom transformation logic.
- Wrote optimized SQL queries for data extraction, transformation, and validation in Redshift, ensuring data accuracy and consistency across systems.
Lead Analyst- Analytics Technology
Infosys Ltd
10.2013 - 01.2022
- Development Enhancement of different Statistical models to analyse the different market & finance risks
- Development & Maintenance of different stat Models for Risk Analysis
- Deployment of the Models in Cloud system using GitLab CI-CD & Docker image creation
- As working from Onsite location, primarily responsible for interacting with client
- Gathering business requests from the clients, determining operational feasibility through analysis, problem definition, requirement analysis, and proposing solution
- Responsible for creating complex SQL reports based on user requirements, analyse the production data, handling data requests from user
- Responsible for developing new batch jobs, packages in BODS ETL tool
- Involved in Database maintenance activity – different sanity checks frameworks, validation of data, resolving tablespace issue, checking the server load, managing database sessions, determining query execution plan
- Creation of python script for the automating module
- Creating Housekeeping framework: Archiving, unloading of the data to different server based on usage
Education
Bachelor of Technology - Electronics and Communication Engineering
St. Thomas' College of Engineering And Technology
06-2013
Skills
- Programming & Scripting: Python, SQL
- Cloud Platforms: AWS
- Databases: Amazon Redshift, Oracle, Netezza, Snowflake
- ETL Tools: Matillion, SAP BODS
- Data Warehousing: Data Modeling, Pipeline Design, Optimization
- Data Analysis & Processing: Data Wrangling, Transformation, Validation
- Data Libraries & Processing Engines: Pandas, DuckDB
- Reporting & Visualization: Basic knowledge of Power BI, Tableau
Accomplishments
- Recognized for the Most Valuable Player Award by the organization for excellent performance in Q2, FY 15
- Successfully completed the Infosys Bridge program on data science in October 2020
- Digital Disrupter Award at Altimetrik in July 2022
Personal Information
- Date of Birth: 10/24/91
- Gender: Male
- Marital Status: Single
Disclaimer
I hereby declare that all the statements written above are true and correct to the best of my knowledge.
Timeline
Staff Software Engineer
BlackHawk Network
07.2024 - Current
Senior Staff Data Engineer
Altimetrik
02.2022 - 06.2024
Lead Analyst- Analytics Technology
Infosys Ltd
10.2013 - 01.2022
Bachelor of Technology - Electronics and Communication Engineering
St. Thomas' College of Engineering And Technology
Similar Profiles
Samantha SellaSamantha Sella
Sales Enablement Manager at Blackhawk NetworkSales Enablement Manager at Blackhawk Network
Scott SScott S
Senior IT Compliance Specialist at Blackhawk NetworkSenior IT Compliance Specialist at Blackhawk Network
Sherna ShereefSherna Shereef
Software Engineer at Blackhawk NetworkSoftware Engineer at Blackhawk Network
Lalitmohan DasLalitmohan Das
Enterprise Engineer-II at Blackhawk NetworkEnterprise Engineer-II at Blackhawk Network
Muskan JainMuskan Jain
Associate – Bid Management at Subex Ltd.Associate – Bid Management at Subex Ltd.