Janaki Raman T

Currently pursuing an MSc in Data Science and Analytics, I am a highly motivated and passionate developer who aspires to use technology to address real-world issues. I have been experimenting with several domains, such as Big Data, Machine Learning, Deep Learning, and Data Science. enthusiastic to learn about new tools and technologies, love exploring, and am passionate about my profession. I'm also constantly hungry to learn new things and grow personally.

HADOOP SEMISTRUCTURED DATA PROCESSING USING AVRO FILE FORMAT

• This project describes how to Transfer data from RDBMS to HIVE in a incremental manner using Sqoop jobs. The Data will be stored in Avro file format .

Responsibilities:

• Performed importing of data files from RDBMS server to appropriate HDFS directories based on file names.
• Processing of data from the files in the HDFS directories and loading the data to appropriate Hive Staging table
• Automated the incremental data append to HIVE tables and schema evolution process using unix shell scripts.
• Technologies: Hadoop3.0, HDFS, Sqoop, Hive, Avro

SPARK-HIVE- Complex JSON Data PROCESSING

• Receiving data from 2 source (WebAPI and HDFS) loading into Spark environment and created Dataframes of the complex json data to analyse the data through multiple stagging area. Done Stiching of data from the HDFS to the web API for better predictive analytics.

Responsibilities:

• Involved in creating HDFS directories to store the data and Hive table.
• Creating Scala code to read the data from the web API and HDFS and to a create a DataFrame.
• Performing actions which include cleansing and transformation of data.
• Pushing the crunched data to Hive table.
• Technologies: Hadoop3.0,HDFS, HIVE,SPARK

• Quick learner
• Self-motivated and Goal oriented
• Teamwork
• Time Management

• A course in Big Data analytics, 05/2023, Zeyobron Analytics
• Artificial Intelligence and Machine Learning Training Course, Infosys Springboard
• Professional Google Workspace Administrator
• Data Warehousing Essentials and DMBOK, Coursera

• Big Data Analytics
• Data Engineering
• Backend Development
• Data Science
• Machine Learning