Summary
Skills
Work History
Education
AccountManager

Rishul Aggarwal

Engineering Manager
Noida,IN

Summary

Engineering lead and manager with 7+ years of experience in working in high-performance teams and delivering solutions to real world problems at large scale with huge impact. Experienced in designing and developing scalable, low latency, high throughput, extensible distributed architecture for enterprise systems both on cloud and on premise.

Skills

    Scala, Java, Python

undefined

Work History

Engineering Manager

Prophecy.io
Noida, India
03.2022 - Current
  • Leading the engineering efforts for the Spark Execution team - hands-on development and end to end ownership for highly optimized and distributed spark code execution in Prophecy SaaS and On-premise deployments on cloud.
  • Added support for computing and storing execution metrics like input/output data flow, data preview and column statistics, for workflows and production jobs running on Spark. Users can see exact historical snapshots of all their workflows in production along with the computed metrics.
  • Led the project delivery for a new Databricks Jobs-based Scheduler within the Prophecy IDE. Users can schedule their workflows to run in their Databricks production environment.
  • Supported user specified maven and other dependencies to be managed on the spark clusters during code execution.

Engineering Manager

Domino Data Lab
Bengaluru, India
08.2021 - 02.2022
  • Managed a team of 4 engineers within the ML-Ops Team.
  • Involved in High-level strategic planning of development efforts across multiple projects to optimize resource utilization and software delivery.
  • Partnered with product and UI and UX teams to create well finished final products.
  • Provided guidance to direct reportees on their career paths.
  • Interviewed, hired and trained new engineers, leading performance reviews and offering constructive feedback.
  • Integrated Model Monitoring project which allowed enterprises to capture model predictions and run data drift and model quality monitoring on their machine learning models in production within a single Domino workbench product. This involved capturing prediction log streams coming from models hosted on Domino Model API system, aggregating them and using Parquet as the storage format for all training, prediction and ground truth datasets to allow faster computation on Spark.

Senior Software Engineer 2

Domino Data Lab
Bengaluru, India
12.2020 - 08.2021
  • Tech Lead in the ML-Ops Team.
  • Owned multiple backend microservices managed on Kubernetes, Maintained a balance between tech debt and new feature development.
  • Mentored software engineers providing guidance on development techniques and career paths.
  • Scaled Domino Model-Monitor's compute engine ~1000x, to support computing Model Quality metrics for datasets up to tens of TBs in size from a few GBs earlier. This involved rewriting the entire compute engine to use Spark for distributed computing to produce hourly aggregate metrics and supporting ad-hoc user queries on top of these aggregate metrics.
  • Improved the Security posture of the enterprise Domino Model-Monitor product by fixing all critical security vulnerabilities in the product.

Senior Software Engineer 2

Sumo Logic
Noida, India
03.2020 - 12.2020
  • This role required me to act as a technical lead and own end-to-end planning and delivery for the Search Ingest Team - a sub team of 4 backend engineers within the Search Team.
  • Led the project to improve the Data Setup and Search experience for Sumo Logic's log analytics platform, with a team of 4 backend engineers, 2 UI engineers and 1 UX designer. This involved multiple product design discussions with the product and UX teams to understand customer behavior, and architectural and design discussions across multiple product areas and backend services.

Senior Software Engineer

Sumo Logic
Noida, India
03.2017 - 02.2020
  • Technical Lead on multiple projects.
  • Re-designed an existing service in Sumo Logic which allowed users to save/retrieve data in lookup tables to support multi-million read/write operations every second on the lookup tables.
  • Supported column based data storage format in both ingest and search pipeline to build the new on-demand pricing model for log analytics
  • Technically mentored and trained new engineers in my team
  • Know-how of running an enterprise grade production system, deployed and managed multiple micro-services
  • Evangelist for adopting best scrum and agile development practices in my team.

Software Engineer

Sumo Logic
Noida, India
06.2015 - 02.2017
  • Developed a new highly available Interval Tree Database micro-service to improve scalability and reliability of an existing microservice. Time to release a new version now took few seconds as compared to a few hours before
  • Developed an offline micro-service to re-process customer data. Improved performance of search queries by as much as 8x, and reduced SLA from a few days to an hour.

Education

Bachelor of Engineering - Computer Engineering

Netaji Subhas Institute of Technology
Delhi, India
08.2011 - 06.2015

High School (Computer Science) -

Delhi Public School
Delhi, India
04.1997 - 03.2011

Similar Profiles

CREATE PROFILE
Rishul AggarwalEngineering Manager