Summary
Overview
Work History
Education
Skills
Timeline
Generic

RAJESH GUPTA

Gurgaon

Summary

Dynamic and results-oriented Principal Engineer, currently excelling at DataPelago. Proven expertise in a broad spectrum of areas, including Manual & Automation Testing, Automation Framework Development, Performance Testing and Tuning, and ML-based Big Data Products Testing and Planning. Detail-oriented Principal Engineer experienced in software development. Reliable and focused on driving technical excellence and organisational success.

Overview

17
17
years of professional experience

Work History

Principal Engineer

DataPelago
Hyderabad, India (Remote)
03.2024 - Current
  • Automation framework development for testing data pipelines on cloud i.e AWS, GCP
  • Performance framework development to performance test Gluten, velox, spark using Jmeter
  • ELK framework setup to visualize performance results
  • GenAI tool to generate test scenarios using feature summary on top of OpenAI
  • Hiring & mentoring team for cloud based testing

Lead Data Engineer

Visa Inc.
Bangalore (Remote)
03.2022 - 03.2024
  • Automation framework design, development & maintaining for big data components like Hive, Spark, Presto
  • Working closely with software engineers, solution engineering & product management from beginning of development cycle to be integral part of engineering team
  • Expertise in Python, PySpark, shell scripting to build robust frameworks
  • Experience in working with variety of data sources including SQL, NoSQL databases & data warehouses
  • Developing comprehensive Test plan, test cases, test scenarios for Hive, Hadoop, PrestoDB, Trino, Ranger prioritizing quality for both functional & non functional testing
  • End-to-End Performance Analysis: Strategize, plan & execute performance testing for Big data products to identify performance issues, latency, resource constraints via Apache JMeter tuning for these engines
  • Taking ownership & driving performance initiative across teams
  • Automation tools for regression: Developed CI pipeline using Jenkins, ansible, shell for nightly regression suite
  • Code & design reviews for team members
  • Leading & mentoring QA team, throughout the software testing lifecycle providing guidance & support
  • Investigating complex performance issues & identifying root causes & prevent recurrence
  • Collaborate with the development team & Architects to review application architecture and identify areas where memory optimisations can be applied
  • Collaborate with multiple stakeholders to manage test environments & test data
  • GenAI tools to generate sql used for engine testing on top of OpenAI
  • Achieved cost-effective cloud-based storage solutions for handling vast amounts of data, resulting in reduced operational expenses and increased scalability.

Senior Member of Technical Staff

Nutanix
10.2019 - 02.2022
  • Automation of Big data product deployed on AWS
  • Building libraries for AWS components
  • Handled a team of 10+ including mentoring and planning tasks
  • Testing and test planning of ML based big data products like discovery engine
  • Performance testing of microservices and algorithms
  • Functional testing of APIs and Web apps
  • Building high performing teams from scratch including campus hiring and lateral hiring
  • Planning and creating tools to enhance productivity at company level
  • Scrum master, managing the sprints across multiple products.

Principal Engineer SDET

Rivigo
04.2017 - 09.2019
  • Automation framework development for API and UI automation
  • Handled a team of 10+, including mentoring and planning tasks
  • Testing and test planning of ML based big data products i.e
  • ETA(estimated time of arrival), Sales prediction model(sales CRM), recommendation engine
  • Performance testing of microservices and algorithms
  • Functional testing of APIs and Web apps
  • Building high performing teams from scratch including campus hiring and lateral hiring
  • Planning and creating tools to enhance productivity at company level
  • Scrum master, managing the sprints across multiple products.
  • Mentored junior engineers in best practices for problem-solving, fostering professional growth and development within the team.
  • Championed continuous improvement initiatives, promoting a culture of innovation and excellence within the organization.
  • Led engineering teams to successfully complete projects on time and within budget.

Senior Team Lead SDET

Snapdeal
04.2016 - 03.2017
  • Analysis, platform selection, design of the technical architecture, application design, testing, and deployment of the proposed solution
  • Evaluate datasets for accuracy and quality
  • Generate ideas to help/improve people, process, and technology that interact with analytic ecosystem gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries etc.)
  • Functional testing of recommendation and notification component for web and app
  • Performance test planning and execution of the plan
  • Big Data Infra planning & setup creation for performance testing
  • Analysis of performance stats and performance tuning of Bigdata applications running on AWS cloud & SD Cloud
  • Performance testing of API/Web Services
  • Automation framework development for performance monitoring
  • Integration of Jmeter with Jenkins and Grafana for performance testing
  • Worked on Cloud Administration tasks such as creating Affinity Group, Storage Accounts, Cloud Services, VPN, DNS server and VPN connectivity
  • Writing Jenkins jobs & chef recipes for CD/CI integration
  • Mentoring the team on Bigdata technologies.

QA Consultant

Guavus Inc.
12.2011 - 12.2015
  • Understanding requirements from FS document
  • Writing Test Plans& test plan review
  • Updating Test Plan and Test results in Testlink
  • Updating project status to Test Director & Program Manager
  • Performance tuning
  • Performance and scalability testing engineer
  • Tracking bugs using Jira
  • Automation using Python and shell scripting
  • Writing scripts to automate data generation required for testing
  • Deployment support & ATP execution
  • Creating test report and share it with Customer and senior management.

Senior Engineer Testing

Ericsson India Private Limited
06.2010 - 07.2011
  • Netops, Telecom, Python, Unix

Software Engineer

Infosys Technologies Ltd
10.2007 - 05.2010
  • Function Testing Engineer
  • Understanding requirements from FS document
  • Writing Test Plans
  • Updating Test Plan and Test results in Mercury Quality Center
  • Tracking bugs using clarify
  • Lab Prime for 3 months
  • Anchor for TL9K audit
  • Part of the Knowledge Management (KM) Team in my Business Unit.

Education

B.Tech, CSE - Computer Science

HMR Institute of Technology And Management, GGS Indraprastha University
New Delhi
05.2007

Skills

  • Languages: Python, Shell scripting, PySpark
  • Big Data: Hive, Hadoop, PrestoDB, Spark
  • Skills: Performance Testing & Optimisation, Test Automation, Continuous integration
  • Cloud: AWS, GCP

Timeline

Principal Engineer

DataPelago
03.2024 - Current

Lead Data Engineer

Visa Inc.
03.2022 - 03.2024

Senior Member of Technical Staff

Nutanix
10.2019 - 02.2022

Principal Engineer SDET

Rivigo
04.2017 - 09.2019

Senior Team Lead SDET

Snapdeal
04.2016 - 03.2017

QA Consultant

Guavus Inc.
12.2011 - 12.2015

Senior Engineer Testing

Ericsson India Private Limited
06.2010 - 07.2011

Software Engineer

Infosys Technologies Ltd
10.2007 - 05.2010

B.Tech, CSE - Computer Science

HMR Institute of Technology And Management, GGS Indraprastha University
RAJESH GUPTA