Ayush Mathur
Senior Data Enginner
Gurugram,HR
Summary
Results-driven Big Data Engineer with over 5 years of expertise in designing and implementing efficient ETL processes. Proficient in Azure Cloud and PySpark, with strong skills in Python, SQL, and cloud-based data platforms. Experienced in collaborating with cross-functional teams to deliver high-quality solutions, consistently achieving project cost savings of approximately 20%. Committed to leveraging advanced data engineering techniques to drive business success and enhance operational efficiency.
Overview
6
6
years of professional experience
2
2
Languages
Work History
Senior Software Engineer
Paytm Payments Bank
09.2024 - Current
- Spearheaded daily data ingestion operations supporting enterprise-wide reporting and data retrieval, managing over 348.3 TB of structured and semi-structured data.
- Designed and maintained robust ingestion pipelines from diverse sources, including relational databases, SFTP, AWS S3, and Kafka, enabling centralized data access for internal teams and external regulatory bodies, such as RBI, ED, CBI, and other government agencies.
- Orchestrated and optimized 2,700+ daily ingestion jobs, processing data from 665+ tables, ensuring timely and accurate data availability for analytics and compliance reporting.
- Acted as the first line of defense between source systems and the DWH by enforcing PII data masking policies, ensuring compliance with data privacy regulations, and minimizing exposure risks.
Sr. Software Engineer L1
Gemini Solutions Pvt. Ltd.
01.2022 - 09.2024
- Executed the development and deployment of a data pipeline, delivering a 25% reduction in data processing time.
- Reduced redundant activities of three departments by building a data warehouse, data modeling, and data ingestion activities.
- Ensured superior data accuracy by implementing effective quality checks, resulting in a 15% improvement.
- Conducted performance tuning on SQL queries, optimizing data retrieval by 20%.
Software Engineer L2
Gemini Solutions Pvt. Ltd.
01.2022 - 03.2023
- Increased code maintainability by 50% and facilitated faster integration of new functionalities by 30%, through the development of self-contained, scalable modules and services.
- Managed Hadoop clusters, including installation, configuration, and maintenance of Hadoop ecosystem components (HDFS, YARN, Hive, HBase, etc.).
- Monitored cluster performance and resource utilization, addressing bottlenecks and failures.
Analyst
Wipro
12.2019 - 01.2022
- Collaborated in developing a data application that increased customer engagement by 30%.
- Automated ETL processes for more efficient data handling, resulting in a 40% reduction in time.
- Implemented data partitioning and replication strategies to ensure data availability and fault tolerance.
- Provided support for Hadoop-related issues, including job failures, performance degradation, and cluster outages.
Education
B.Tech - IT
DIT University
Dehradun, India05-2019
Skills
Apache Spark
undefinedAccomplishments
- On The Spot Award Q1 Financial Year : 2023-24
Websites, Portfolios and Profiles
https://www.linkedin.com/in/ayush-mathur-228027105/
Timeline
Senior Software Engineer
Paytm Payments Bank
09.2024 - Current
Sr. Software Engineer L1
Gemini Solutions Pvt. Ltd.
01.2022 - 09.2024
Software Engineer L2
Gemini Solutions Pvt. Ltd.
01.2022 - 03.2023
Analyst
Wipro
12.2019 - 01.2022
B.Tech - IT
DIT University