GOWTHAM MAHENDRAN

• Having almost 6+ years of experience in designing and developing Big Data applications using the Hadoop Ecosystem technologies (HDFS, Hive, Sqoop, Apache Spark and AWS).
• Domain experience includes Finance,Insurance,Retail. Real time experience in Hadoop/Big Data related technology experience in Storage, Querying, Processing and analysis of data.
• Understands the Complex Data Processing needs of big data and have experience in developing codes and modules to address those needs.
• Capable of processing large sets of Structured and Semi-structured data.
• Worked on AWS Components like S3, EMR.
• Worked with different file formats like JSON, XML, AVRO data files and text files.
• Worked extensively on Hadoop migration project and POCs.
• Expertise in writing Hadoop Jobs for analyzing data using Hive.
• Experience in importing and exporting data using Sqoop from HDFS to RDBMS and vice-versa.
• Knowledge in installing, configuring, and using Hadoop ecosystem components like HDFS, Hive, Sqoop, and Spark.
• Brought in simplification process and Optimization initiatives to bring efficiency into applications.
• Proficient in optimizing Sqoop imports and exports for performance and scalability.
• Experienced in designing and implementing complex data integration solutions using Sqoop.
• Experience in handling hive schema evolution with avro file format .
• Roficient in handling hive partitions and buckets with respect to the business requirement.
• Skilled in handling semi structured/serialized data processing using hive (AVRO,PAQUET,ORC).
• Experienced in efficiently using Hive managed and external table with respect to the business requirement. Deep knowledge in incremental imports, partitioning and bucketing concepts in Hive and Spark SQL needed for optimization.
• Proficient in developing and implementing Spark RDD-based data processing workflows using Scala, or Python programming languages.
• Experienced in optimizing Spark RDD performance by tuning various configuration settings, such as memory allocation, caching, and serialization.
• Skilled in using Spark RDD persistency and caching mechanisms to reduce data processing overhead and improve query performance.
• Familiarity with Spark RDD lineage and fault tolerance mechanisms and their impact on data processing reliability and performance.
• Expertise in using Spark RDD transformations and actions to process large-scale structured and unstructured data sets, including filtering, mapping, reducing, grouping, and aggregating data.
• Having hands on experience in deploying spark jobs over EMR cluster as a step execution.
• Used Agile methodology to work with IT and business team to progress efficient system development.
• Data base experience in SQL Server and MYSQL.
• Have good problem solving and analytical skills and ready to innovate in order to perform better.
• Have strong Interpersonal skills and communication skills.

WORK EXPERIENCE

HDFC BANK LIMITED – AUGUST- 2019 – Present

JANA SMALL FINANCE BANK – JULY 2016 – AUGUST- 2019