Summary
Overview
Work History
Education
Skills
Languages
Timeline
Generic

Abhishek Singh

Bengaluru

Summary

Experienced data engineer with 9+ years of industry expertise and a bachelor's degree in Computer Science. Proficient in designing end-to-end pipelines, including data warehousing, data modeling, programming, and streaming loads development. Known for meticulous attention to detail and organizational skills, excelling in fast-paced environments with tight deadlines. Eager to contribute to the company's success as an enthusiastic team player.

Overview

10
10
years of professional experience

Work History

Sr. Software Engineer

Lowe's Service
05.2016 - Current
  • Objective of this project is to improve users search/browse experience by providing more relevance results for their search by collecting different types off signal while user browse site.
  • Build data pipelines to ingest and analyze user behavior (e.g., browsing history, past searches, and purchase patterns) in real-time.
  • Implement ETL (Extract, Transform, Load) processes to ensure high-quality, clean, and enriched product data.
  • Develop automated data quality checks and validation pipelines to detect and fix missing or inconsistent product information.
  • Develop a recommendation system that tailors search results based on individual user preferences and historical data.
  • Integrate external data sources (e.g., supplier catalogs, reviews, social media trends) to enrich the product dataset and improve search accuracy.
  • Collaborated with team of data scientists, product manager and architected, to build data platform (process TB of data daily, both streaming and batch) for microservices to consume and launched AB test, resulting in significant improvement in user experience.
  • Managed multiple projects simultaneously while maintaining strict deadlines and high-quality standards.
  • Maintained comprehensive documentation of development work, facilitating knowledge sharing among team members.
  • Enhanced software functionality by identifying and resolving complex technical issues.
  • Capabilities: Python, Pyspark, Dataproc, Dataflow, Airflow, SQL, BigQuery, Data Collection, Data cleaning, Data Integration, DevOps, Mongo DB

Software Engineer

Capgemini
12.2014 - 03.2016
  • Design and develop efficient ETL processes for data ingestion, integration, and analytics
  • Design and implement data models, databases, and data warehouses for data storage and analysis
  • Establish and maintain technical environment for data analysis, such as databases and data warehouses in cloud environment
  • Create and maintain secure data transfer pipelines, including streaming and batch-oriented solutions
  • Analyze historical traffic data to forecast network usage trends and anticipate future demand.
  • Build data models to analyze customer complaints, dropped calls, and service request data, correlating this with network performance.
  • Identify problem areas (e.g., geographic regions with low coverage or frequent outages) and recommend network upgrades or expansions.
  • Collaborated with management, internal and development partners regarding software application design status and project progress.
  • Capabilities: Python, Airflow, Dataproc, Data cleaning, Data Integration, Data collection

Education

Bachelor of Science - Computer Science And Engineering

Biju Pattnaik University of Technology
09.2012

High School Certificate - Science

Loyola School
05.2008

Skills

  • Programming Language: Python, SQL
  • Clod Platform and database: Google Cloud platform, PostgreSQL, Mongo DB
  • Data Engineering: Airflow, ETL, BigQuery, Spark, Data Warehousing, Pandas, Numpy
  • DevOps: GIT, Jenkins, Docker, Kubernetes (basic) GCS

Languages

English
Advanced (C1)
Hindi
Advanced (C1)

Timeline

Sr. Software Engineer

Lowe's Service
05.2016 - Current

Software Engineer

Capgemini
12.2014 - 03.2016

High School Certificate - Science

Loyola School

Bachelor of Science - Computer Science And Engineering

Biju Pattnaik University of Technology

Similar Profiles

CREATE PROFILE
Abhishek Singh