Summary
Overview
Work History
Education
Skills
Certification
Work Preference
Timeline
Generic

Amit Mishra

Software Professional
Bengaluru,Karnataka

Summary

Having 7+ years of experience in Big Data, Search, and Backend technologies. My passion lies in technologies such as Spark, Hadoop, Elastic Search, Kafka, Java, Python, and AWS. Built Search and Data pipelines from scratch, taking ownership of end-to-end features and modules. Successfully collaborated with cross-functional teams to deliver search features and data pipelines. Seeking challenging missions to learn, excel, and contribute to dynamic teams and organizations.

Overview

7
7
years of professional experience
1
1
Certification
4
4
years of post-secondary education

Work History

Sr. Software Engineer

Rafay System Pvt. Ltd
Bengaluru, Karnataka
05.2022 - Current
  • Created a data simulator for QA testing, boosting team efficiency by 20%
  • Implemented Spark ETL Pipeline to consolidate/Rollup TimeSeries table, reducing master database overhead by 25%
  • Designed and optimized the Time Series database, lowering costs and maintenance by 40%
  • Developed a feature for real-time data cardinality insights using Elasticsearch and Java
  • Established a Spark Stream Pipeline for cost monitoring, leading to a 12% reduction in expenses
  • Enhanced OpenTSDB with Java and added join and sorting capabilities
  • Gained experience with Docker and Kubernetes, including image building and local container deployment from Docker Hub for rapid development
  • Exposure in designing HBase row keys for sorted data storage and implementing multi-tenancy for speedy data retrieval
  • Possess intermediate-level proficiency in AWS EMR (Elastic MapReduce) for advanced big data processing and AWS S3 for efficient data storage and retrieval.

Lead Engineer

Moglix.com
, UP
12.2018 - 05.2022
  • Spearheaded 80% of Search API development and optimized caching
  • Orchestrated data migration and intricate data preparation with Spark and Python
  • Designed and deployed ETL pipelines utilizing Spark and Java
  • Optimized Category, Brand suggestions, resulting in a 20% boost in search hits
  • Enhanced search API response time by 30%
  • Elevated search results by 35% through improved brand and category identification
  • Achieved a 0.2% to 0.5% conversion rate increase with search result optimization
  • Implemented product scoring for brand and category promotion, resulting in a 30% rise in PDP views
  • Provided guidance and mentorship to two junior team members
  • Utilized Jupyter Notebook for complex data analysis using Python.

Software Engineer

ClearTrail Technologies Pvt. Ltd
, UP
08.2016 - 12.2018
  • Installed, configured, and maintained a 7-node Hadoop (HDP/HDF) Cluster
  • Collaborated on Java utility development for analytical products
  • Designed, optimized, and deployed Spark pipelines
  • Developed Kafka producer for testing Spark Streaming with template data to detect lag
  • Created an Indexer to enhance Apache Solr's fast data retrieval from HBase by 40%
  • Configured NiFi processor to efficiently transfer 10GBs of data from FTP to HDFS
  • Implemented a weekly HDFS data rotation using a Cron Job, cutting storage costs by 15%
  • Implemented a Shell script as a daemon service to ensure high availability and fault tolerance.

Education

B.Tech - Computer Science & Engineering

Maulana Azad National Institute of Technology, MANIT (NIT)
07.2012 - 05.2016

Skills

  • Python
  • Java
  • Spark
  • Kafka
  • Elasticsearch
  • NoSQL
  • MySQL
  • Hive
  • AWS
  • Docker
  • BigQuery
  • HDFS
  • Hadoop
  • Redis

Certification

System Design Data Pipeline Big Data Ecosystem Data Modeling Search Ecosystem Data Analysis Collaboration Reliable ACTIVITIES & ACHIEVEMENTS Attained All India Rank 7141, placing in the top 0.1% in AIEEE 2012. Nominated as a top performer in 2021 at Moglix. Recognized as Star of the Month (Feb 2018) and Star of the Quarter (July-Sep 2018) at ClearTrail.

Work Preference

Work Type

Full Time

Location Preference

On-Site

Timeline

Sr. Software Engineer

Rafay System Pvt. Ltd
05.2022 - Current

Lead Engineer

Moglix.com
12.2018 - 05.2022

Software Engineer

ClearTrail Technologies Pvt. Ltd
08.2016 - 12.2018

B.Tech - Computer Science & Engineering

Maulana Azad National Institute of Technology, MANIT (NIT)
07.2012 - 05.2016

Similar Profiles

CREATE PROFILE
Amit MishraSoftware Professional