Ashish Tyagi

Work History

Data Architect

Success Stories

I have total of 11 years experienced, where I have been
associated with KPMG for around 6 years and TCS for 5 years.
More than 10 years of experience on Data Engineering using
Big Data on Cloud platforms (AWS|
Cloudera) and on-premise server.
Over 4 years, I enhanced data management efficiency by
designing and implementing enterprise data architecture
solutions.
Extensive experience in ETL methodology for performing
Extraction, Transformation and Loading using different ETL tools.
Involved in writing Data Transformations, Data Cleansing using
Apache Spark operations.
Optimized query performance through effective indexing
techniques, reducing response times and improving user
satisfaction.
Delivered actionable insights through advanced analytics and
reporting tools, empowering decision-makers to make
data-driven choices.
Championed best practices in data warehousing methodologies,
driving consistency across multiple development initiatives.
Mentored junior team members in advanced concepts related
to enterprise data architecture, fostering a culture of continuous
learning and professional growth.
Data Lake and Data Warehouse implementation for FMCG (GPI)
& Automobile (MSIL) on Cloud
ecosystem.
Collaborated with cross-functional teams to identify business
requirements and translate them into technical specifications.

Enterprise Data Architect

HSBC

04.2024 - Current

Evaluated emerging technologies in the field of enterprise data
management, recommending innovative solutions that aligned
with business objectives.
Developed a robust data quality management framework,
increasing the accuracy and reliability of enterprise-wide
information assets.
Enable consumers to securely view, validate and adjust data
with comprehensive data control and auditing. This framework
helped business team to validate and perform manual
adjustment.
Introduced tooling to automate data classification and stiching
to HBIM at scale (Big ID, Collibra Edge).
ESG Local Metastore for Automated Asset Registration custom
data tagging. Evaluation of local catalogue tool like Datahub
and OpenMetadata.
Led the migration of legacy systems to modern platforms,
minimizing downtime and ensuring smooth transitions for
endusers.
Conducted thorough assessments of current database
environments, identifying areas for improvement and
recommending strategic enhancements.
Developed comprehensive data models, ensuring alignment with
organizational goals and industry best practices.
Designed custom ETL processes to facilitate seamless
integration between disparate systems, improving overall
operational efficiency.
Spearheaded efforts in metadata management, enabling
accurate tracking of information assets across the organization.
Designed internal process improvements to automate repetitive
tasks, shortening data delivery times.

Platform Lead

Macquarie Bank

09.2021 - Current

Lead Architecture, Design, and implementation of Data Governance Tool for Data Set Registration and access management in Macquarie Bank.
Building the python client which will help the consumer to consume the API to build and send the JSON message.
Implemented Splunk HTTP event collector for lambda logs.
Implemented Java Based application to trigger SNS event and create SQS queues for handling API calls to Lambda and redshift.
Created and maintained a roadmap of customer enhancements according to the customer's decisions and directions.

AWS Data Engineer Lead

Maruti Suzuki India Limited

02.2021 - 08.2022

Implemented advanced automated Data Ingestion pipeline using ETL Talend and AWS services like S3, Glue and Redshift.
Implemented PoC on Talend Data Catalog and Data Stewardship.
Implementation of crawlers on data for better flexibility. Finally, data must be secured to ensure your data assets are protected.
Scalable and Modular Central data Repository to dynamically store integrated and aggregated data on AWS stack.
Developed and designed Data Catalogue and Curated Layer exposing data engineered accessibility to Data scientists, Data developers, and Business analysts.
Working model for Machine Learning principles, Predictive analytics, data discovery and profiling.
Implemented centralized configuration table on DynamoDB to handle ETL pipeline with maintaining logging for each table ingestion to different layer of data lake.
Glue job failure notification using SNS.
Developed state machines (Step Functions) to orchestrate the ETL workload.
Implemented Data Lake and Data Warehouse solutions for MSIL on AWS Redshift with implementation of SCD type 2 to cater reporting of KPI's on Power BI with audit logging.

Senior Hadoop Lead

Godfrey Phillips India Limited

11.2019 - 02.2021

Implemented Data Lake using Cloudera Hadoop Cluster.
Data integrated from Oracle ERP, Lakshya, MATS-MDC, MDM and IDB schemas.
Moreover implemented Numerous Analytics and Power BI dashboards as per business Requirements.
Implemented Numerous Data Analytics Project like DEXIT, GMC Analytics, Checkout Upsell, SO, MCQ etc.
Delivered company's crucial and sensitive finance transactions reports.
Production and Development support for code, data and logical enhancements and load failures.
Helped GPI in Master data Mappings & watch on exceptional data patterns.

Hadoop Developer

American Express

02.2019 - 10.2019

Facilitate periodic analysis of externally sourced data for ingestion.
Independently designed MapReduce solutions to parse raw data, populate staging tables & store processed data in EDW.
Rendered assistance to team by creating Hive queries to identify emerging market trends.
Facilitated effective reviews and utilized automation techniques for faster ingestion.
Built a generic reusable template and in-house tool to increase fast development and reduced 45% code repetition.
Selected out of 7500+ employees to receive the Star Performer of the Quarter Award '19 for extraordinary performance.

Hadoop and ETL Analyst

Virgin Media

01.2015 - 03.2019

Lead a team of 7 Analysts to install, configure & test Hadoop ecosystem components.
Supervised Job scheduling via Oozie and managed data ingestion by deploying Sqoop, HBase and WINSCP.
Assessed business rules, collaborated with key stakeholders & performed source-to target data mapping and design.
Directed advanced data processing, ETL optimization.
Analyzed Log files for Hadoop ecosystem services & conducted Root Cause Analysis to diagnose & resolve 150+ issues.
Achieved a reduction in data processing time by 78% by designing automated solutions for Hadoop in Python.
Design and Developed Dot Net framework application - AUPA.
Design and Developed Compliance Tracker application driven on Bootstrap and MVC framework.
Migrate BIS portal to Compatible IE11 platform.

Summary

Overview

Work History

Data Architect

Enterprise Data Architect

Platform Lead

AWS Data Engineer Lead

Senior Hadoop Lead

Hadoop Developer

Hadoop and ETL Analyst

Education

Btech -

Certification

Domains

Timeline

Similar Profiles

Lilly AhlfeldLilly Ahlfeld

David BeasleyDavid Beasley

Stacy FilipkowskiStacy Filipkowski

ANJALI SINGHANJALI SINGH

ISHAN SAXENAISHAN SAXENA