Abhishek Kumar
Bengaluru
Summary
Experienced Senior Data Engineer with a strong focus on geospatial data, boasting 6+ years of expertise in Software Development, GIS Engineering, and Data Engineering. Skilled in developing GIS and mapping software, designing efficient data pipelines, and optimizing cloud infrastructure for cost reduction. Proven track record of leading projects that improve operational efficiency and performance by leveraging technologies like Python, C++, AWS services, and open-source tools.
Overview
8
8
years of professional experience
Work History
Senior Data Engineer | GIS Engineer
Cropin Technology Solutions
05.2020 - Current
- Developed a GIS image server to serve image tiles from GeoTIFFs on-the-fly using open-source projects, saving the company millions of INR annually compared to commercial solutions. Deployed the stack on AWS using EKS, S3, PostgreDB, and Python.
- Created automated data pipelines to ingest satellite imagery from public sources (Sentinel, Landsat), transitioning into a Data Engineer role. Designed a cost-effective, highly scalable pipeline that reduced processing time from weeks to hours, utilizing self-deployed Apache Airflow, AWS services (EKS, Batch, S3, PostgreDB), MongoDB, and Python.
- Implemented a scalable logging service for AWS Batch tasks using AWS OpenSearch and a custom microservice, resulting in a 90% reduction in logging costs compared to paid services like DataDog. Deployed the service on AWS EKS, using Python.
- Deployed a highly scalable vector image server to serve tiled images from vector data sources for a client delivery, achieving the same functionality as a paid service at just 2% of the cost (saving almost 8 million INR per year) using open-source projects.
Software Developer
Tonbo Imaging
09.2017 - 04.2020
- Developed a sophisticated mapping software for integration with military-grade long-range imaging devices, including binoculars, thermal cameras, and digital weapon scopes.
- Designed a user interface in QT that displayed geographical maps of the deployment area and surrounding regions, allowing for real-time control and task assignment for the devices.
- Implemented two-way communication between the software and devices to reflect real-time status and actions of the equipment.
- Integrated 3-D map features to provide detailed terrain views, enhancing operational awareness and strategic planning.
- Language/Tools: C++, QT, QGIS
Education
B. Tech - Computer Science and Engineering
IIIT Guwahati
01.2017
Skills
- Automation of GIS data workflows
- Proficient in Python programming
- Data pipeline development
- Data warehousing expertise
- Proficient in AWS and GCP
- Performance and cost optimisation
- Data pipeline orchestration with Apache Airflow
Timeline
Senior Data Engineer | GIS Engineer
Cropin Technology Solutions
05.2020 - Current
Software Developer
Tonbo Imaging
09.2017 - 04.2020
B. Tech - Computer Science and Engineering
IIIT Guwahati
Similar Profiles
Ravishankara H. SRavishankara H. S
Senior Finance Specialist at Cropin Technology Solutions Pvt LtdSenior Finance Specialist at Cropin Technology Solutions Pvt Ltd
ADILAKSHMI VADAVALLIADILAKSHMI VADAVALLI
Associate Data Scientist at Cropin technology solutionsAssociate Data Scientist at Cropin technology solutions
Mayank VyasMayank Vyas
Assistant Manager - Customer Success (SEA & India) at CropIn Technology SolutionsAssistant Manager - Customer Success (SEA & India) at CropIn Technology Solutions
Anish SinghalAnish Singhal
SAT, IB HL & SL, IGCSE A & AS Level at Crimson EducationSAT, IB HL & SL, IGCSE A & AS Level at Crimson Education
Hithaishi SHithaishi S
AP Accountant at Adecco India Pvt. Ltd.AP Accountant at Adecco India Pvt. Ltd.