Chinmay Tornekar

Roles & Responsibilites

• Overall 2.5+ years of extensive experience in different domains in the IT industry and mainly in Spark SQL, Spark streaming include tune-up of the Spark applications using SQL and Python (Pyspark).
• Performed POC's on Spark based Data Lake augmented by a Cloud based Data Lake on Azure.
• Got acquainted with the latest features on Azure lakehouse like
  Delta lake, Photon, Delta live table, Multi-hop-Architecture, Delta Pipelines, Unity catalogue.
• Have a knowledge on Amazon web services mainly S3, EC2,AWS EMR, IAM Role,RDS,Glue,Lambda,Athena.
• Capable of processing large sets of structured, semi structured and unstructured data.
• Hands on experience with Big Data core components and Eco System including Data Ingestion and Data Processing (PySpark, Hive, SQOOP, HDFS and MapReduce, Oozie Job Scheduler.)
• Very Good understanding of Partitioning, bucketing concepts in Hive and designed both Internal and External tables in Hive to optimize performance.

Projects

1.Data Handling and Analytics in Transportation Domain

Tasks:

• To monitor existing DLT Pipelines
• To Perform Data-cleaning in Databricks Notebooks using SQL queries.
• To perform Data Integration and Transformations in order to process the raw data coming in ADLS GEN2
• To Read the logs in case of Job failures using WEB-UI application in Databricks