Hariom Jat
Dubai
Summary
Senior Data Engineer with over 6+ years in the Information Technology sector, boasting a specialized focus on Big Data for the past 5 years. Proficient in the design and maintenance of both Batch and Streaming data pipelines, showcasing expertise in key technologies such as Hadoop, Spark, Kafka, Python, Flink, PySpark, Apache Beam, Java, SQL, data modeling, and data warehousing.
Recognized for strong problem-solving abilities, consistently achieving on-time project delivery. A skilled and articulate communicator, fostering effective collaboration within multidisciplinary teams. Deeply passionate about harnessing the power of Big Data to facilitate data-driven decision-making.
Extensive project experience spans the dynamic realms of telecom, finance, and banking, offering a unique amalgamation of industry-specific insights and technical acumen to drive successful project outcomes.
Overview
7
7
years of professional experience
Work History
Senior Data Engineer
Bitech Middle East (ENBD)
08.2023 - Current
- Real-time Transaction Processing: Designed and implemented a real-time transaction processing system for a leading banking client, leveraging Apache Flink to achieve low-latency data processing.
- Data Pipelines: Built end-to-end data pipelines with Apache Beam, ensuring the reliable and efficient transfer of real-time streaming data from source to destination.
- Implemented Kafka for real-time transaction processing in banking.
- Collaborated with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver tailored real-time solutions for business use case.
- Optimized data pipelines by implementing advanced ETL processes and streamlining data flow.
- Enhanced system performance by designing and implementing scalable data solutions for high-traffic applications.
- Developed custom algorithms for efficient data processing, enabling faster insights and decision-making.
- Collaborated with cross-functional teams to define requirements and develop end-to-end solutions for complex data engineering projects.
Senior Data Engineer
Enquero (A Genpact Company) (VMware)
04.2021 - 08.2023
- Build scalable databases capable of ETL processes using SQL and Spark.
- Experience in analyzing data using Hive QL.
- Implemented a scalable data pipeline using Apache Beam, Cloud Dataflow, and BigQuery for efficient data validation in the finance domain.
- Well versed with agile methodology and participated in daily scrum calls and the sprint planning sessions.
- Designed and implemented a real-time data processing pipeline using Kafka and Apache Beam to handle high-volume data streams.
- Developed data pipeline using various big data file formats, including Parquet, Avro, ORC, CSV and JSON.
- Environment: Java, PySpark, Python, Sqoop, GIT, Hadoop, Linux, HIVE, HDFS, Apache Spark, Spark SQL, Apache Kafka, Apache Beam, GCP.
Big Data Developer
Reliance JIO Platform LTD
06.2018 - 04.2021
- Researched, designed and implemented scalable applications for data extraction, analysis, retrieval and indexing.
- Modified existing databases to meet unique needs and goals determined during initial evaluation and planning process.
- Expertly utilize distributed/parallel processing for variety of data.
- Working knowledge of Hadoop framework & its components with skills in developing efficient algorithms and improving data quality.
- Manage production support teams to make sure to provide resolution in a timely fashion.
- Worked with business and technical lead to define implementation design and coding of assigned modules with highest quality.
- Involved in complete Big Data flow of application starting from data ingestion from upstream to HDFS, processing and analyzing data in HDFS.
- Used Spark API over Hortonworks Hadoop YARN to perform analytics on data in HBase.
- Design and implement work flow jobs using Unix / Linux scripting to perform ETL on Hadoop Platform.
- Environment: Java, Eclipse, SVN, GIT, Hadoop, Linux, Apache Tomcat, HBase, HDFS, Apache Spark, Spark SQL.
Software Engineer
INNOEYE TECHNOLOGIES PVT. LTD
06.2017 - 06.2018
- Reviewed project specifications and designed technology solutions that met or exceeded performance expectations.
- Revised, modularized and updated old code bases to modern development standards, reducing operating costs and improving functionality.
- Involved in technical design, logical data modelling, data validation verification, data cleansing, data scrubbing.
- Followed agile methodology for the entire project.
- Designed and developed APIs for serving the data using Dropwizard microservice.
- Used Apache Tomcat Application Server for deploying the application.
- Responsible for loading data from UNIX file system to HDFS using shell script, java APIs.
- Developed ETL Process using SPARK, HDFS and HBase.
- Experienced on loading and transforming of large sets of structured, semi and unstructured data.
- Environment: Java, Eclipse, SVN, Hadoop, Linux, Apache Tomcat, HBase, HDFS, Spark, Drop-wizard, Spring, Hibernate, REST API.
Education
Bachelor of Engineering - Computer Science
SVCE (RGPV)
Indore05.2017
Higher Secondary -
School Of Excellence
Ratlam06.2013
High School -
School Of Excellence
Ratlam06.2011
Skills
- Java
- Python
- Apache Spark
- Apache Kafka
- Apache Beam
- Apache Flink
- Cloudera
- Shell/Bash Scripting
- Hive
- SQL
- HBase
- RDBMS
- Linux, Windows
- GCP
- PostgreSQL
- PySpark
Languages
English
Upper intermediate
B2
Hindi
Bilingual or Proficient (C2)
Personal Information
• Birth of Date : 09th July 1996
• Present Address : Dubai, UAE
• Marital Status : Married
Timeline
Senior Data Engineer
Bitech Middle East (ENBD)
08.2023 - Current
Senior Data Engineer
Enquero (A Genpact Company) (VMware)
04.2021 - 08.2023
Big Data Developer
Reliance JIO Platform LTD
06.2018 - 04.2021
Software Engineer
INNOEYE TECHNOLOGIES PVT. LTD
06.2017 - 06.2018
Bachelor of Engineering - Computer Science
SVCE (RGPV)
Higher Secondary -
School Of Excellence
High School -
School Of Excellence
Similar Profiles
Abdulla Khalid Sultan AlkaabiAbdulla Khalid Sultan Alkaabi
HR recruiter at Bitech Middle EastHR recruiter at Bitech Middle East
Hadeel AbubakerHadeel Abubaker
Sales junior associate Emirates NBD / Jun 2024 - at ENBDSales junior associate Emirates NBD / Jun 2024 - at ENBD
Naushar NasarullaNaushar Nasarulla
HVAC - Senior Sales and Technical Manager at Lennox Middle East (LNX Middle East)HVAC - Senior Sales and Technical Manager at Lennox Middle East (LNX Middle East)
SADIQ ABBASSADIQ ABBAS
Banking Advisor at Fintrek Marketing Management LLCBanking Advisor at Fintrek Marketing Management LLC
NAVAS MOHAMEDNAVAS MOHAMED
Digital Marketing Manager & Team Lead at Invisor Management Training LLCDigital Marketing Manager & Team Lead at Invisor Management Training LLC