Summary
Overview
Work History
Education
Skills
Timeline
Generic

Amit Abhishek

Bangalore,Karnataka

Summary

Engineered an automated ETL process that streamlined data ingestion, cleansing, and loading operations. This led to a 60% reduction in cost and a remarkable 30-fold improvement in query performance.

Overview

12
12
years of professional experience

Work History

Tech Lead

Lumosity Lumos Labs
12.2024 - Current
  • Designed and implemented a scheduling framework for reporting and analytics use cases, reducing turnaround time (TAT) from a minimum of 2 days to just minutes.
  • Developed an end-to-end data pipeline leveraging AWS DMS and Snowpipe, eliminating reliance on third-party tools and resulting in significant cost savings.
  • Led a globally distributed team with a fully remote working model, effectively managing collaboration with team members based in Serbia.
  • Liaised with business stakeholders to gather and understand reporting requirements, and translated them into scalable and efficient data solutions.

Tech Lead

Lendingkart Technologies
05.2019 - 12.2024
  • Complete Adoption of Organization-wide Data Lake for enhanced query performance and a cost-effective solution:
  • Engineered and deployed a robust internal pipeline using Spark and Scala to securely transfer data from MySQL, Postgres, and SFTP to Data Lake, accelerating data processing by 40% and ensuring data integrity.
  • Orchestrated the implementation of a comprehensive Data Lake solution, integrating OLAP and OLTP functionalities for enhanced reporting; optimized data storage and retrieval processes, resulting in a 35% increase in data accessibility and analysis efficiency.
  • Slashed per TB costs by 60% while boosting query performance by 30 times.
  • Migrated over 2000 reporting queries to ANSI-SQL compliance Data Lake.
  • Mentoring Team and Stakeholder Support:
  • 1. Instituted a framework for expediting query resolution for stakeholders.
  • 2. Tailored personalized roadmaps for new employees based on the experience levels.
  • 3. Automated the generation of input-output metrics, providing transparent insights into team performance for directors and CXOs.
  • Leverage available data resources to drive customer acquisition at zero cost - currently undergoing patenting process.
  • Developed an automated process in Python within two days to generate moratorium and repayment schedules adhering to RBI guidelines during the Covid-19 pandemic.
  • Translated technical concepts and information into terms parties could easily comprehend.

Senior Software Engineer

Iquanti Inc
07.2016 - 04.2019
  • Company Overview: iQuanti's SEO optimization product is built on ML, to predict the behavior of Google's organic search algorithm and forecast search outcomes.
  • Developed - Traffic estimator, Pre-launch simulation, Keyword Analysis, Rank and traffic forecast, and Back-link Analysis.
  • IQuanti's SEO optimization product is built on ML, to predict the behavior of Google's organic search algorithm and forecast search outcomes.

Sr. Developer

Mu-Sigma Business Solutions
06.2013 - 07.2016
  • Developed Data Platform to integrate structured and unstructured data.
  • Developed a sophisticated data pipeline system with Akka framework in Scala, integrating social media APIs (Twitter, Facebook, SocialGist) to enable real-time data processing and analysis for actionable business intelligence.
  • Developed streaming pipeline from Twitter GNIP with Kafka integration for streamlined event propagation, enabling rapid data ingestion and processing.

Education

M.Tech - Computer Science

NIT Warangal

Skills

  • ETL
  • SQL
  • Python
  • Scala
  • Rust
  • Apache Spark
  • Kubernetes
  • AWS
  • Hadoop
  • Snowflake
  • Delta

Timeline

Tech Lead

Lumosity Lumos Labs
12.2024 - Current

Tech Lead

Lendingkart Technologies
05.2019 - 12.2024

Senior Software Engineer

Iquanti Inc
07.2016 - 04.2019

Sr. Developer

Mu-Sigma Business Solutions
06.2013 - 07.2016

M.Tech - Computer Science

NIT Warangal

Similar Profiles

CREATE PROFILE
Amit Abhishek