Summary
Overview
Work History
Education
Skills
Accomplishments
Timeline
Generic

Rishab Daga

Bengaluru

Summary

Expert in developing data pipelines with a focus on efficient data ingestion and modeling techniques that enhance analytical processes. Proven track record in utilizing big data analytics to optimize performance and ensure high-quality results in data management projects. Skilled in implementing version control methodologies to improve collaboration among technical teams. Dedicated to applying data engineering expertise to drive organizational success in fast-paced environments.

Overview

5
5
years of professional experience

Work History

Data Engineer III

Walmart
Bengaluru
08.2023 - Current
  • Documented data architecture designs and changes to enhance system maintainability and knowledge transfer.
  • Managed version control and deployment of data applications using Git, Docker, and Jenkins (in-built tool).
  • Collaborated with stakeholders to define business requirements for analytics solutions and recommended best practices.
  • Conducted training sessions on Big Data analytics topics to enhance team capabilities.
  • Implemented performance tuning through query and index optimization; advised hardware upgrades as needed, achieving run time reduction of 50-200% and ensuring SLA compliance.
  • Facilitated collaboration with cross-functional teams to translate business needs into technical specifications for data solutions.
  • Optimized queries to improve performance and reduce server load.
  • Had upgraded over 700 data pipelines from Spark 2 to Spark 3, resulting in savings of $70K a year.

Associate Data Engineer

TheMathCompany
Bengaluru
08.2022 - 08.2023
  • Developed Python and Bash scripts to automate execution of pre-built models.
  • Provided optimization techniques to data science team, reducing costs and execution time.
  • Created and managed Google DataProc clusters, optimizing configurations based on usage.
  • Designed and implemented a robust data ingestion pipeline on Azure cloud for manufacturing data.
  • Leveraged Azure Data Factory for batch data collection from diverse manufacturing systems and sensors.
  • Orchestrated data ingestion workflows including validation, transformation, and loading into Azure storage solutions.
  • Implemented best practices for data ingestion, ensuring encryption, integrity checks, and error handling.

Data Engineer

Tata Consultancy Services LTD
Bengaluru
09.2020 - 08.2022
  • Collaborated with business owners to translate requirements into precise technical specifications.
  • Developed robust data ingestion applications for efficient capture of critical data into data lake.
  • Designed scalable data models to analyze customer transaction history for actionable insights.
  • Generated comprehensive reports to support informed decision-making for consumption team and management.
  • Orchestrated Automic DAG for reliable data processing and provided L3 support for issue resolution.
  • Streamlined Teradata pipeline, identifying improvements to enhance efficiency.
  • Created Teradata equivalent queries for seamless data migration to BigQuery, improving scalability.
  • Converted and obtained business signoff for approximately 74,000 jobs, ensuring smooth system transition.

Development Intern

Mindfire Solutions
Bhubaneswar
01.2020 - 06.2020
  • Developed .exe application in C# for calculating individual taxpayer tax obligations.
  • Created Resume Builder web application using ReactJs and .NET MVC to simplify resume creation.

Education

Bachelor in Technology - Computer Science

Silicon College of Engineering
Bhubaneshwar
05-2020

Skills

  • Scala and Python
  • Google Cloud Platform
  • Kafka
  • PySpark and Spark SQL
  • Data modeling
  • Airflow and Automic
  • Kubernetes
  • DevOps for data pipelines

Accomplishments

  • On-the-Spot Award - Tata Consultancy Services, Sep 2021, for exceptional performance, consistently delivering outstanding results, and demonstrating a strong sense of ownership
  • Team Excellence Award - Tata Consultancy Services, Mar 2022, fostering collaborative teamwork, and consistently achieving excellence
  • Bravo Award - Walmart
  • Impact Award - Walmart, for implementing a solution that hugely saves a lot of operational costs for the organization and makes a significant contribution to cloud cost optimization

Timeline

Data Engineer III

Walmart
08.2023 - Current

Associate Data Engineer

TheMathCompany
08.2022 - 08.2023

Data Engineer

Tata Consultancy Services LTD
09.2020 - 08.2022

Development Intern

Mindfire Solutions
01.2020 - 06.2020

Bachelor in Technology - Computer Science

Silicon College of Engineering

Similar Profiles

CREATE PROFILE
Rishab Daga