Summary
Overview
Work History
Education
Skills
Certification
Website
Hackathons
Timeline

Vallari Rastogi

Software Engineer

Summary

Detail-oriented, organized, and meticulous employee. Works at fast pace to meet tight deadlines. Enthusiastic team player ready to contribute to company success.

Overview

4
4
years of professional experience
2
2
Certifications

Work History

Software Engineer

Microsoft
1 2024 - Current
  • Part of Fabric Live Table Team (Development Stage), whose work is to orchestrate Spark Jobs That support Materialized Views/Live Tables in a microservice architecture
  • Handling, Debugging and Improving C# API implementation for spark Jobs Dag(s) generation & Execution, Dag Execution History for UI across and error handling.
  • Adding complete UT coverage for the same
  • Implementing Client interfaces to leverage other fabric services.

Software Engineer

Microsoft
06.2022 - 01.2024
  • Responsible for developing, building, testing, debugging, deploying HA, fault-tolerant Flink Clusters on Kubernetes
  • Played major role in 5+ Customer Onboarding, mostly that are to do with Flink SQL/formats, HA availability, Integration with other Azure offerings
  • Integrated Flink SQL Service into existing systems, increasing AAD security capability and improving overall performance.
  • Flink was integrated with HMS, Hive, and was made to support delta, Iceberg and Hudi Format
  • Integrated SQL Gateway service that support third party client like Beeline.
  • Actively engaged with OSS Issues on integration bugs
  • Enabled common Platform Service Script Action for HILO clusters and was particularly useful for Flink class loading issues.

Cloud Data Engineer

Intel Technologies
08.2020 - 05.2022
  • Developed rule-based predictive analysis of compute/memory requirements for a spark function (resource utilization metrics), and optimize, if possible, spark SQL queries by reducing exchange and sort exercises in physical plan
  • Benchmarked AWS EMR spark flavor on Intel, AMD and Graviton using TPC-DS
  • Improvement in spark SQL perf by 37% for 1 TB TPCDS run by tuning spark conf parameters
  • Benchmarked Intel Gazelle spark Engine against TPC-DS
  • Presented best practices from Spark cluster configuration, DW Storage Layout, spark config settings and physical plan POV at Intel Bootcamps to 100+ APJ Customers (single-handedly by me).

Technical Intern

Intel Technologies
- 05.2020
  • Curated Intel OpenVINO applications, for Intel EII (Intel edge software)
  • Enabled TCS Customers to build/deploy their Data Analytics models on EII and extending the scope of EII for Time-Series use case.

AI and Compute Performance Intern

Intel Technologies
- 12.2019
  • Trained UNET Model for Tumor segmentation in 3D Brain MRI images using Distributed Deep Learning Framework Horovod on top of Open MPI / Intel MPI to reduce the training Time without compromising the accuracy of the model RESULT: Training time for each epoch reduced from 3 hours to 125 seconds with 82% dice-coefficient
  • Optimized the NN model to minimize False-Positive/True-Negative cases by playing with loss function.

Education

IIIT Bhubaneswar

Skills

AWS / Azure

System Design

Workloads – Flink / Spark/ Kafka / Hive

Language – Java/ Python /C#/ SQL

Resource utilization Analysis

Databases – MySQL, Postgres

Data Structures and Algorithms

Docker/Kubernetes (Advanced)

Python

Software Development

Software Design

API Development

Testing and debugging

Git proficiency

Linux

Algorithm implementation

API design

Feature and Application Implementation

Performance Optimization

Certification

Azure Fundamentals AZ900

Website

https://github.com/Rastogii, https://www.hackerrank.com/vallari_rastogi1

Hackathons

  • Top 8 Finalist in Intel Python Hack Fury
  • Top 10 finalist in Axis Bank AI Hackathons

Timeline

Software Engineer - Microsoft
06.2022 - 01.2024
Cloud Data Engineer - Intel Technologies
08.2020 - 05.2022
Software Engineer - Microsoft
1 2024 - Current
Technical Intern - Intel Technologies
- 05.2020
AI and Compute Performance Intern - Intel Technologies
- 12.2019
IIIT Bhubaneswar - ,
Vallari RastogiSoftware Engineer