Detail-Oriented, organized, versatile software engineer specializing in big data technologies. Proven expertise in designing and implementing scalable solutions, optimizing data processing workflows, and ensuring the efficiency of large-scale system.
Hi, I’m
Harshit Gupta
Software Engineer 2
Bengaluru
Summary
Overview
3
years of professional experience
4
years of post-secondary education
Work History
Cloudera
Software Engineer 2
5 2023 - Current
Job overview
- Working on highly performant fault tolerant storage layer that reads and writes petabytes of data across thousands of nodes.
- Improving Hadoop FileSystem connectors for Object Stores such as S3, ABFS and GCS. Successfully delivered project goals by implementing new features, and adhering to stringent timelines. Committed to open source Hadoop.
- Worked with AWS team to integrate new S3 Express SDK with our stack. New integration provides 25% speed improvement on any job and sub-second read/write latencies.
- Working on Ranger based authorization for fast object stores.
- Developed python library from scratch to authorize S3 access using Ranger. Library works OOTB for our clients and supports over 20 different operations. Library is published in open source pypi for use.
- Working on Scale Based Testing of various components like Spark and Hadoop.
Cloudera
Associate Software Engineer
07.2021 - 05.2023
Job overview
- Improving Big Data Query Engines such as Hive, Tez and Spark. Worked on performance optimization of query compilers and executors.
- Worked on optimizing storage formats like ORC,Parquet and Iceberg for high performance vectored reads.
Google Summer Of Code
Student With ENSEMBL-EBI
05.2019 - 09.2019
Job overview
- Developed a pipeline to parse and process the homologous gene dataset, then use them to predict the homologous genes using Deep Neural Networks.
Education
BMSITBangalore
Bachelor's of Engineering from Computer Science
08.2017 - 07.2021
University Overview
Skills
Java, C, Python, GoLang
Availability
See my work availability
Not Available
Available
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Timeline
Associate Software Engineer
Cloudera
07.2021 - 05.2023
Student With ENSEMBL-EBI
Google Summer Of Code
05.2019 - 09.2019
BMSIT
Bachelor's of Engineering from Computer Science
08.2017 - 07.2021
Software Engineer 2
Cloudera
5 2023 - Current
Similar Profiles
Aishwarya GopalakrishnanAishwarya Gopalakrishnan
Senior Business System Analyst at ClouderaSenior Business System Analyst at Cloudera
Rakshit Mulya SRakshit Mulya S
Cutomer Interaction Specialist at ClouderaCutomer Interaction Specialist at Cloudera
Raghav ChitkaraRaghav Chitkara
Senior Software Engineer at ClouderaSenior Software Engineer at Cloudera
Kalyan KalvagaddaKalyan Kalvagadda
Senior Engineering Manager, Infrastructure Development at ClouderaSenior Engineering Manager, Infrastructure Development at Cloudera
Hemendu JoshiHemendu Joshi
Lead Technology Manager – Creative Technology & Innovation Management at UnileverLead Technology Manager – Creative Technology & Innovation Management at Unilever