Sravan Kumar E
Bengaluru
Summary
Motivated, solution-oriented professional with 5 years of technical expertise in Big Data-Hadoop Ecosystem and Data Warehousing. Enthusiastic and experienced in Spark Scala/Python, SparkSQL, Hive etl development and various performance optimizations on Spark and Hadoop environment including Hive, Hdfs, Sqoop and Unix shell scripting
Overview
6
6
years of professional experience
Work History
Hadoop Developer
Publicis Sapient
12.2019 - 01.2022
- Worked for a Retail Client on a data migration project from Edgenode, HDFS storage system to a cloud based platform where data is stored in GCS.
- Worked on developing aSpark-Scala program that ingests csv data files into hive table. Developed SparkSQL code to create ETL process, transformations on top of Retail analytics data for each system and store them in flattened tables segregated by Month wise partitions, which will be used by downstream users for analysis.
- Worked on some Value added services in the project like POCs on moving from Crontab jobs to Airflow scheduling, Automating scripts, DQ checks.
- Supported project management activities by maintaining detailed documentation of design decisions, implementation progress, testing results, and deployment plans throughout the entire software development lifecycle.
- Worked in devops tools like Jenkins, as well as versioning tools like GitHub, thereby forming continuous integration pipeline, worked in Airflow job scheduling platform to schedule jobs and automate project flows and dependencies, worked in Agile environment
Hadoop Developer
Tata Consultancy Services
07.2016 - 09.2019
- Worked for leading US Travel Transport and Hospitality Client, developed a tool to migrate data between netezza and Hadoop, responsible for overall process of data migration to handle various scenarios like Data cleaning, Data Integration and Synonym approaches to handle data discrepancies and data corruptions
- Worked for leading US Travel Transport and Hospitality Client, developed spark program, shell scripts and hqls to perform various etl transformations on top of clickstream data and store them as a flattened hive tables, which will be used by downstream tableau users to create dashboard for business
- Worked on POC to Develop airflow python script to experiment airflow time based scheduling, conditional statements, email operators, hive operator, trigger dag run operator and external task sensor concepts
Education
Bachelor of Engineering -
Jawaharlal Nehru Technological University (A)
04.2016
Skills
- SparkSQL
- Spark - Scala
- Spark - core
- Hive
- Unix - Shell Scripting
- SQL
- GCS
Personal Information
Title: HADOOP DEVELOPER
Timeline
Hadoop Developer
Publicis Sapient
12.2019 - 01.2022
Hadoop Developer
Tata Consultancy Services
07.2016 - 09.2019
Bachelor of Engineering -
Jawaharlal Nehru Technological University (A)
Similar Profiles
MODINAT OLUTUNDEMODINAT OLUTUNDE
Agile Project Manager at Publicis SapientAgile Project Manager at Publicis Sapient
AMIT GUPTAAMIT GUPTA
Senior Manager - Agile Program Management at Publicis SapientSenior Manager - Agile Program Management at Publicis Sapient
Sugandha RajSugandha Raj
Product Owner at Publicis SapientProduct Owner at Publicis Sapient
Tushar KaushikTushar Kaushik
Specialist Infrastructure at Publicis Sapient Groupe LtdSpecialist Infrastructure at Publicis Sapient Groupe Ltd
Abdul Kabaar Khan AAbdul Kabaar Khan A
Restaurant Administrator at New Ambur BriyaniRestaurant Administrator at New Ambur Briyani