Ravi Kumar
Lead Data Engineer
Bengaluru
Summary
- 10+ years of experience in developing data lakes and bigdata pipelines leveraging Big Data technologies in Financial and Networking Domains.
- Good understanding of Big Data Architecture(HLD): HDFS, MapReduce, Hive, Pig, Scoop, Flume, Kafka, Apache Phoenix, Spark, HBase, Cassandra using Java/Scala as primary and Python as secondary programming language.
- An accomplish software engineer specializing in Object-Oriented Design(LLD) and Analysis with extensive experience in the full life cycle of the software design process
- Expertise in analysis, design, development, testing and maintenance of large scale object oriented applications.
- Extensive experience using Data Structures and Writing Algorithms.
- Highly motivated, results oriented and leadership skills with great team ethics.
- Good Communication, interpersonal skills and problem solving skills.
Overview
14
14
years of professional experience
4
4
years of post-secondary education
Work History
Lead Data Engineer
Sigmoid Analytics
02.2024 - Current
- Led design of data pipeline architecture for three major big data products, driving innovation and efficiency.
- Constructed adaptable data pipelines for processing semi-structured/structured data from diverse sources.
- Developed NoSQL databases (HBase, Cassandra) with optimized table structures for high-performance data applications.
- Directed ingestion of streaming and historical data across primary sources using Spark, Kafka, Hadoop, and Java/Scala/Python.
Lead Data Engineer
Globallogic
01.2020 - 12.2021
- Spearheaded design of robust data pipeline architectures for three innovative big data products from inception.
- Engineered data pipelines capable of processing diverse semi-structured and structured data from multiple sources.
- Pioneered construction of NoSQL databases (HBase) and formulated optimal table structures for high-performance data-intensive applications.
- Orchestrated ingestion of streaming and historical data across varied primary sources utilizing Apache Spark, Kafka, Hadoop, and Java/Scala.
Senior Data Engineer
Colortokens Inc
06.2018 - 05.2019
- Architected data pipeline infrastructure for groundbreaking network security product, contributing to its success from conceptualization.
- Constructed agile data pipelines handling semi-structured/structured data from various sources.
- Engineered NoSQL databases (Cassandra) with tailored table structures for robust data-intensive applications.
- Implemented streaming and historical data ingestion processes using Spark, Kafka, and Java/Scala.
Senior Data Engineer
Juniper Networks
2 2016 - 5 2018
- Led design of data pipeline architecture for three major big data products, driving innovation and efficiency.
- Constructed adaptable data pipelines for processing semi-structured/structured data from diverse sources.
- Developed NoSQL databases (HBase) with optimized table structures for high-performance data applications.
- Directed ingestion of streaming and historical data across primary sources using Spark, Kafka, Hadoop, and Java/Scala.
Data Engineer
Impetus Infotech
12.2014 - 08.2015
- Processed TB's of transactional data in cluster of 50 nodes using Hive data store.
- Building recommendation engine by analyzing data from hive data store.
Software Engineer I & II
Eka Software Solutions Pvt Ltd
11.2010 - 11.2014
- Involved in low level design and development of CTRM product with leverage to technologies like Java, J2EE, Spring, Hibernate and SQL.
- Indulged in coding business logic as well as presentation logic.
- Involved in integration of layers across invoicing module.
Education
B.Tech - Computer Science
Guru Ghasidas Vishwavidyalaya
Bilaspur, CG 05.2006 - 05.2010
Skills
- Java,Scala,Python
Hadoop, Apache Spark, Hive
Hbase, Cassandra, SQL
Kafka
AWS, Kubernetes
Data Structures & Algorithms
Object Oriented Design(LLD) & HLD
Timeline
Lead Data Engineer
Sigmoid Analytics
02.2024 - Current
Lead Data Engineer
Globallogic
01.2020 - 12.2021
Senior Data Engineer
Colortokens Inc
06.2018 - 05.2019
Data Engineer
Impetus Infotech
12.2014 - 08.2015
Software Engineer I & II
Eka Software Solutions Pvt Ltd
11.2010 - 11.2014
B.Tech - Computer Science
Guru Ghasidas Vishwavidyalaya
05.2006 - 05.2010
Senior Data Engineer
Juniper Networks
2 2016 - 5 2018
Similar Profiles
Shristi PradhanShristi Pradhan
Software Development Engineer III at Sigmoid AnalyticsSoftware Development Engineer III at Sigmoid Analytics
MOHITH REDDYMOHITH REDDY
SDE 1 - Data Engineering at SIGMOID ANALYTICSSDE 1 - Data Engineering at SIGMOID ANALYTICS
Debapriya DasDebapriya Das
Director Data Science (Data Science Leadership) at Sigmoid AnalyticsDirector Data Science (Data Science Leadership) at Sigmoid Analytics
Neeraj GuptaNeeraj Gupta
Technical Lead at Sigmoid AnalyticsTechnical Lead at Sigmoid Analytics
Hemanth RHemanth R
Digital Marketing Intern at BGS & SJB GroupsDigital Marketing Intern at BGS & SJB Groups