Summary
Overview
Work History
Education
Skills
Timeline
Generic

RAJESH GUPTA

Gurgaon

Summary

Dynamic and results-oriented Principal Engineer, currently excelling at DataPelago. Proven expertise in a broad spectrum of areas, including Manual & Automation Testing, Automation Framework Development, Performance Testing and Tuning, and ML-based Big Data Products Testing and Planning. Detail-oriented Principal Engineer experienced in software development. Reliable and focused on driving technical excellence and organisational success.

Overview

17
17
years of professional experience

Work History

Principal Engineer

DataPelago
03.2024 - Current
  • Automation framework development for testing data pipelines on cloud i.e AWS, GCP
  • Performance framework development to performance test Gluten, velox, spark using Jmeter
  • ELK framework setup to visualize performance results
  • GenAI tool to generate test scenarios using feature summary on top of OpenAI
  • Hiring & mentoring team for cloud based testing

Lead Data Engineer

Visa Inc.
03.2022 - 03.2024
  • Automation framework design, development & maintaining for big data components like Hive, Spark, Presto
  • Working closely with software engineers, solution engineering & product management from beginning of development cycle to be integral part of engineering team
  • Expertise in Python, PySpark, shell scripting to build robust frameworks
  • Experience in working with variety of data sources including SQL, NoSQL databases & data warehouses
  • Developing comprehensive Test plan, test cases, test scenarios for Hive, Hadoop, PrestoDB, Trino, Ranger prioritizing quality for both functional & non functional testing
  • End-to-End Performance Analysis: Strategize, plan & execute performance testing for Big data products to identify performance issues, latency, resource constraints via Apache JMeter tuning for these engines
  • Taking ownership & driving performance initiative across teams
  • Automation tools for regression: Developed CI pipeline using Jenkins, ansible, shell for nightly regression suite
  • Code & design reviews for team members
  • Leading & mentoring QA team, throughout the software testing lifecycle providing guidance & support
  • Investigating complex performance issues & identifying root causes & prevent recurrence
  • Collaborate with the development team & Architects to review application architecture and identify areas where memory optimisations can be applied
  • Collaborate with multiple stakeholders to manage test environments & test data
  • GenAI tools to generate sql used for engine testing on top of OpenAI
  • Achieved cost-effective cloud-based storage solutions for handling vast amounts of data, resulting in reduced operational expenses and increased scalability.

Senior Member of Technical Staff

Nutanix
10.2019 - 02.2022
  • Automation of Big data product deployed on AWS
  • Building libraries for AWS components
  • Handled a team of 10+ including mentoring and planning tasks
  • Testing and test planning of ML based big data products like discovery engine
  • Performance testing of microservices and algorithms
  • Functional testing of APIs and Web apps
  • Building high performing teams from scratch including campus hiring and lateral hiring
  • Planning and creating tools to enhance productivity at company level
  • Scrum master, managing the sprints across multiple products.

Principal Engineer SDET

Rivigo
04.2017 - 09.2019
  • Automation framework development for API and UI automation
  • Handled a team of 10+, including mentoring and planning tasks
  • Testing and test planning of ML based big data products i.e
  • ETA(estimated time of arrival), Sales prediction model(sales CRM), recommendation engine
  • Performance testing of microservices and algorithms
  • Functional testing of APIs and Web apps
  • Building high performing teams from scratch including campus hiring and lateral hiring
  • Planning and creating tools to enhance productivity at company level
  • Scrum master, managing the sprints across multiple products.
  • Mentored junior engineers in best practices for problem-solving, fostering professional growth and development within the team.
  • Championed continuous improvement initiatives, promoting a culture of innovation and excellence within the organization.
  • Led engineering teams to successfully complete projects on time and within budget.

Senior Team Lead SDET

Snapdeal
04.2016 - 03.2017
  • Analysis, platform selection, design of the technical architecture, application design, testing, and deployment of the proposed solution
  • Evaluate datasets for accuracy and quality
  • Generate ideas to help/improve people, process, and technology that interact with analytic ecosystem gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries etc.)
  • Functional testing of recommendation and notification component for web and app
  • Performance test planning and execution of the plan
  • Big Data Infra planning & setup creation for performance testing
  • Analysis of performance stats and performance tuning of Bigdata applications running on AWS cloud & SD Cloud
  • Performance testing of API/Web Services
  • Automation framework development for performance monitoring
  • Integration of Jmeter with Jenkins and Grafana for performance testing
  • Worked on Cloud Administration tasks such as creating Affinity Group, Storage Accounts, Cloud Services, VPN, DNS server and VPN connectivity
  • Writing Jenkins jobs & chef recipes for CD/CI integration
  • Mentoring the team on Bigdata technologies.

QA Consultant

Guavus Inc.
12.2011 - 12.2015
  • Understanding requirements from FS document
  • Writing Test Plans& test plan review
  • Updating Test Plan and Test results in Testlink
  • Updating project status to Test Director & Program Manager
  • Performance tuning
  • Performance and scalability testing engineer
  • Tracking bugs using Jira
  • Automation using Python and shell scripting
  • Writing scripts to automate data generation required for testing
  • Deployment support & ATP execution
  • Creating test report and share it with Customer and senior management.

Senior Engineer Testing

Ericsson India Private Limited
06.2010 - 07.2011
  • Netops, Telecom, Python, Unix

Software Engineer

Infosys Technologies Ltd
10.2007 - 05.2010
  • Function Testing Engineer
  • Understanding requirements from FS document
  • Writing Test Plans
  • Updating Test Plan and Test results in Mercury Quality Center
  • Tracking bugs using clarify
  • Lab Prime for 3 months
  • Anchor for TL9K audit
  • Part of the Knowledge Management (KM) Team in my Business Unit.

Education

B.Tech, CSE - Computer Science

HMR Institute of Technology And Management, GGS Indraprastha University
New Delhi
05.2007

Skills

  • Languages: Python, Shell scripting, PySpark
  • Big Data: Hive, Hadoop, PrestoDB, Spark
  • Skills: Performance Testing & Optimisation, Test Automation, Continuous integration
  • Cloud: AWS, GCP

Timeline

Principal Engineer

DataPelago
03.2024 - Current

Lead Data Engineer

Visa Inc.
03.2022 - 03.2024

Senior Member of Technical Staff

Nutanix
10.2019 - 02.2022

Principal Engineer SDET

Rivigo
04.2017 - 09.2019

Senior Team Lead SDET

Snapdeal
04.2016 - 03.2017

QA Consultant

Guavus Inc.
12.2011 - 12.2015

Senior Engineer Testing

Ericsson India Private Limited
06.2010 - 07.2011

Software Engineer

Infosys Technologies Ltd
10.2007 - 05.2010

B.Tech, CSE - Computer Science

HMR Institute of Technology And Management, GGS Indraprastha University

Similar Profiles

CREATE PROFILE
RAJESH GUPTA