SHIVAM AGARWAL
Noida
Summary
- Seasoned professional with a decade of expertise in Test Data Management (TDM), Data Governance, and ETL processes.
- Proven track record of designing and implementing comprehensive TDM solutions, ensuring optimal data mining, and driving 100% test case execution.
- Designed and implemented Delphix TDM solutions for BFSI and retail clients, enabling faster environment provisioning and reducing refresh cycle times from weeks to hours.
- Configured Delphix Virtual Databases (vDBs) and automated refresh pipelines to support agile and DevOps testing environments.
- Delivered data masking solutions using Delphix Masking Engine to ensure compliance with GDPR and internal audit requirements.
- Integrated Delphix APIs with CI/CD pipelines (Jenkins, Azure DevOps) for automated provisioning and teardown of test environments.
- Partnered with DBAs and developers to troubleshoot performance issues, optimize storage usage, and enforce data security policies.
- Integrated MDM with cloud-native platforms (AWS, Azure) for scalable hybrid deployments.
- Collaborated with business stakeholders to establish governance policies and resolve data ownership conflicts.
- Strong background in collaborating with cross-functional teams and stakeholders, demonstrating effective communication skills.
- Committed to staying current with industry best practices and trends in TDM and ETL technologies, to deliver innovative and impactful solutions.
- Defining and applying data masking, data subsetting, and data generation following various data provisioning strategies, and building and maintaining a Gold Copy repository. TDM Tools used are K2 View, Tonic ai, Broadcom CA TDM, Delphix and done the POC for Informatica ILM and IBM Optim along with Genrocket artificial data generation.
- Developing a Test Data Management strategy and solution to adhere to compliance regulations on PII data usage in non-production environments, and to optimize the overall efficiency of the testing strategy.
- Defining and applying data masking, data subsetting, and data generation, following various data provisioning strategies, and building and maintaining a Gold Copy repository.
- Developing, maintaining, and enhancing TDM capabilities by employing repeatable processes, a governance framework, automation, and various tools/utilities.
- Extensive experience in designing and implementing ETL processes for extracting, transforming, and loading data from diverse sources into target systems.
- Expertise in SQL and knowledge of database management systems to efficiently query, manipulate, and optimize data storage.
- Ability to leverage ETL tools to streamline and automate data integration workflows, enhancing efficiency, and reducing manual intervention.
- Experience in fine-tuning ETL workflows for optimal performance and scalability, meeting business requirements and deadlines.
Overview
12
12
years of professional experience
Work History
TDM Architect/Project Manager
Capgemini
Noida
04.2022 - Current
- Highly skilled and results-driven Test Data Management (TDM) Architect with over 12 years of experience in strategizing, implementing, and optimizing TDM processes. Proven expertise in leveraging tools such as Tonic AI, K2 View, CA Broadcom, Delphix, and GenRocket to enhance test data quality, security, and efficiency. Adept at leading cross-functional teams and driving continuous improvement in TDM practices.
- Defined and executed a comprehensive TDM strategy aligned with organizational goals.
- Provided leadership to a team of TDM professionals, fostering collaboration and innovation.
- Deployed Collibra and Informatica Axon to establish a unified governance framework for enterprise data assets.
- Built metadata management and lineage tracking solutions to support compliance and audit requirements.
- Conducted data quality assessments and defined KPIs to improve accuracy, completeness, and consistency.
- Implemented Delphix for data virtualization, reducing provisioning time by 40%.
- Utilized GenRocket for synthetic data generation, enhancing test scenario diversity.
- Spearheaded initiatives to optimize TDM processes, resulting in 40% improvement in efficiency.
- Established and enforced best practices for TDM, ensuring adherence to industry standards.
- Implemented robust data masking techniques using CA Test Data Manager to safeguard sensitive information.
- Developed strategies for efficient data subsetting, reducing the volume of test data without compromising representativeness.
- Collaborated with infrastructure teams to plan and provision test environments with the required data sets.
- Implemented version control for test data, ensuring consistency across multiple environments.
- Integrated TDM processes seamlessly with CI/CD pipelines, enhancing the agility of the development lifecycle.
- Collaborated closely with development and testing teams to understand data requirements and ensure timely provisioning of test data.
- Maintained comprehensive documentation for TDM processes, tools, and configurations.
- Generated regular reports on test data usage, compliance, and efficiency to support decision-making.
Module Lead
Mphasis
Noida
11.2021 - 04.2022
- Develop and implement a comprehensive strategy for test data management aligned with overall project goals.
- Provide leadership to the TDM team, ensuring effective collaboration with development, testing, and operations teams.
- Assess and select appropriate TDM tools based on organizational needs, cost, and scalability.
- Oversee the implementation of CA Broadcom tool for efficient test data management.
Engineer Senior Specialist
NTT DATA
Noida
05.2020 - 11.2021
- Led the development and execution of a comprehensive TDM strategy aligned with organizational objectives.
- Provided leadership to a team of TDM professionals, fostering collaboration and innovation.
- Selected and implemented CA Broadcom for advanced data masking and subsetting, optimizing test data processes.
- Implemented Delphix for data virtualization, resulting in a 35% reduction in provisioning time.
- Utilized GenRocket for synthetic data generation, enhancing the diversity of test scenarios.
- Spearheaded initiatives to optimize TDM processes, achieving a 35% improvement in efficiency.
- Established and enforced best practices for TDM, ensuring compliance with industry standards.
- Implemented robust data masking techniques using CA Test Data Manager to safeguard sensitive information and developed strategies for efficient data subsetting.
Senior Test Analyst G1
Global Payments (TSYS)
Noida
11.2018 - 05.2020
- Test Data Management End to End Implementation for Multiple Applications.
- Leading the team at Offshore, working as the Primary POC for entire client interactions.
- Developing a test data management strategy and solution to comply with PII data usage regulations in non-production environments while also increasing the overall efficiency of the testing strategy.
- Defining/applying Data Masking, Data Sub-setting, Data Generation, and building/maintaining a Gold Copy repository using various data provisioning strategies.
- Using repeatable processes, a governance framework, automation, and various tools/utilities develop, maintain, and improve TDM capabilities.
- Provisioning Test Data through Data mining/Generation processes for various Testing Teams as per their data needs.
- Interaction and coordination with Dev & Testing Stakeholders.
- Experience in Data Analysis, Data Validation, Data Cleansing, Data Verification.
- Experienced in creating Test Data for ETL testing.
- Responsible for gathering requirements via client calls, understanding requirements and changes in applications, implementing them as per business needs.
- Knowledge of Agile methodology.
- Participated in continuous improvement by generating suggestions, engaging in problem-solving activities to support teamwork.
- Managed team of 6 employees, overseeing hiring, training, and professional growth of employees.
Senior Software Test Engineer
Xavient Software Solutions Pvt Limited
Noida
09.2016 - 11.2018
- A Test Data Management (TDM) developer is responsible for designing, implementing, and managing processes related to the creation, provisioning, and maintenance of test data for software testing purposes. Their role is critical in ensuring that testing environments have the necessary data to simulate real-world scenarios and validate software functionality.
- Collaborate with testing teams to understand and analyze test data requirements for various testing scenarios.
- Implement data masking techniques to anonymize sensitive information in test environments.
- Develop processes for generating synthetic test data when real data is unavailable or inadequate.
- Create automated processes for refreshing test environments with up-to-date and relevant test data.
- Manage relationships between different data entities to maintain referential integrity in test environments.
- Collaborate with DevOps teams to synchronize TDM processes with CI/CD pipelines.
- Implement measures to ensure that test data handling complies with data security and privacy regulations.
- Document TDM processes, including data generation rules, masking strategies, and provisioning procedures.
Test Analyst II
Total System Solutions
Noida
11.2015 - 09.2016
- An ETL (Extract, Transform, Load) developer is responsible for designing, developing, and maintaining the ETL processes that facilitate the flow of data within an organization. These professionals play a crucial role in ensuring data accuracy, integrity, and availability for analysis and reporting purposes.
- Collaborate with stakeholders to understand data integration requirements. Analyze source and target data structures to design effective ETL processes.
- Extract data from various source systems, such as databases, flat files, and APIs.
- Implement efficient and scalable methods for extracting large volumes of data.
- Design and implement transformations to convert raw data into a format suitable for analysis. Cleanse and validate data to ensure accuracy and consistency.
- Develop processes for loading transformed data into target systems, such as data warehouses or databases. Optimize loading processes for performance and reliability.
- Implement automation scripts and workflows to schedule and monitor ETL processes.
- Identify opportunities for process optimization and performance tuning.
- Develop mechanisms for detecting and handling data integration errors. Implement logging and notification systems to alert stakeholders of issues.
- Implement data quality checks and validation rules to ensure data integrity. Work with data stewards to resolve data quality issues.
- Create comprehensive documentation for ETL processes, including design specifications, data mappings, and workflow diagrams. Keep documentation up-to-date to facilitate knowledge transfer and system maintenance.
Senior Implementation Analyst
Mercer Consulting India Pvt Limited
Noida
12.2013 - 10.2015
- Gathering/clarifying/understanding the requirements from onshore counterparts for new implementation clients and creating/updating technical specification documents from already created maps via client call.
- Preparation of various documents like Work breakdown structure, Bug status reports, Defect prevention, Weekly & Monthly work progress.
- Involved in preparation and maintenance of Framework.
- Co-coordinating with onshore resources in various aspects, resolving queries and establishing a smooth communication channel with the client affecting project timelines, and communicating project-related issues and challenges with the offshore team to maximize efficiency.
- ETL Processes from flat files to ETL fine tuned reports generations.
Education
B.TECH - Computer Science
K.P.Engineering College
Agra, Uttar Pradesh01.2013
Skills
- TDM (Test Data Management) tools - Broadcom CA TDM, K2 View, Tonic ai, GenRocket, Delphix, Informatica TDM, IBM Optim
- Data Governance Tools: Collibra, Informatica DQ, Axon, Alation, Ataccama
- DATABASES - ORACLE, SQL SERVER, SNOWFLAKE, POSTGRESQL
- ETL Tools - OWB, TALEND
- PROGRAMMING - PL/SQL, VB Scripting, Python
- DOMAIN - Banking and Finance, Healthcare, Insurance, Manufacturing
- JIRA
- MS Excel Automation
- TOAD
- API
- Data masking techniques
- Test data provisioning
- CI/CD integration
- Synthetic data generation
Languages
English Proficient, Hindi Native
References
- Abhishek, Shrivastava, +91-9717014875
- Shubham, Mittal, +91-9811142875
Accomplishments
- TDM Implementation Successfully implemented a TDM solution for a large Banking and Insurance client, resulting in a 40% reduction in manual test data generation.
- Cross-Functional Collaboration Collaborated with cross-functional teams to develop a comprehensive data mining solution, resulting in a 50% increase in efficiency.
STRENGTHS
- Strategic Data Project Leadership
- 10 years of hands-on experience managing IT projects, specializing TDM, data governance, and ETL processes.
- Successfully led end-to-end project lifecycles, aligning technology initiatives with organizational goals. Delivered visually compelling TDM solutions, ensuring data integrity, and optimizing ETL workflows for enhanced decision-making and business success.
Timeline
TDM Architect/Project Manager
Capgemini
04.2022 - Current
Module Lead
Mphasis
11.2021 - 04.2022
Engineer Senior Specialist
NTT DATA
05.2020 - 11.2021
Senior Test Analyst G1
Global Payments (TSYS)
11.2018 - 05.2020
Senior Software Test Engineer
Xavient Software Solutions Pvt Limited
09.2016 - 11.2018
Test Analyst II
Total System Solutions
11.2015 - 09.2016
Senior Implementation Analyst
Mercer Consulting India Pvt Limited
12.2013 - 10.2015
B.TECH - Computer Science
K.P.Engineering College