Vikas Goswami
Bangalore
Summary
AWS Certified Solutions Architect associate and BigData/Hadoop Administrator, Skilled and proactive Engineer professional with 9 years of hands-on experience in Hadoop Administration , AWS services EMR and Unix/Linux shell scripting. Advance knowledge of Hadoop Cluster management and Unix/Linux/Solaris script development. Supportive, enthusiastic, quick learner and team player.
Overview
9
9
years of professional experience
1
1
Certification
Work History
Cloud Engineer - BigData
Amazon Web Services
Banaglore
07.2021 - Current
- Primarily responsible for solving customer cases by applying advanced troubleshooting techniques to provide tailored solutions and working with them to deep dive into the root cause of the issue.
- Provided advanced technical support to internal teams and external clients of AWS EMR.
- Troubleshoot and optimize existing AWS infrastructure for Big Data and ETL workloads.
- Worked with enterprise-level customers of AWS EMR to help them migrate their workload from on-premises to AWS EMR.
- Worked on complex issues of EMR and helped various customers to come out of production impact.
Hadoop/ AWS EMR Admin
Cognizant Technology Solutions
Bangalore
07.2019 - 07.2021
- Experience in migration of Hadoop application/Users from On prem to AWS
- Experience in managing EMR cluster and its services like Hive ,Yarn, S3 , Hbase, Zookeeper etc.
- Experience setting up and configuring IAM policies ( roles, user, groups ) for security and Identity Management.
- Experience installing/upgrading Apace HUE multiple times and making it available for users to query Hive,Presto,HDFS.
- Experience installing Presto query engine with Hive catalog and integrating it HUE using sql alchemy and JDBC both.
- Experience in configuring YARN queues for better resource allocation among various jobs in the cluster.
- Experience in installing Apache Airflow. Also making two instances run in the same server and integrating Airflow web UI with LDAP to enable user login.
- Creating Scripts for User onboarding automation , Monitor EBS volumes encryption.
- Experience installing Mysql /Maria DB databases and integrate them as backend for HUE and airflow.
Hadoop Administrator
Tata Consultancy services
Bangalore
07.2015 - 07.2019
- Managed/Administered Hortonworks Hadoop cluster on Ambari. That includes HDFS storage, YARN resource management , HIVE etc.
- Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause for Job failures
- Done commissioning and decommissioning of Data Nodes in Hadoop cluster
- Upgraded HUE from version 4.3 to 4.6 and migrating user data to the new version that includes saved queries , history and session information.
- Experience installing Python and pip as local user on shared Linux ( version 3.7 )
- Created Health check scripts for servers. Developed script to collect the weekly/monthly server stats send the report over mail. Have used HTML in shell scripts
Education
Bachelor of Engineering - Computer Science And Engineering
Samrat Ashok Technological Institute
Vidisha05-2015
Skills
- AWS EMR
- Migration - Hadoop OnPrem to AWS
- Spark , Hive, HUE ,Presto, Airflow, HDFS, YARN
- Shell Scripting
- IAM, S3 , EC2
Certification
- AWS Certified Solutions Architect - Associate
Timeline
Cloud Engineer - BigData
Amazon Web Services
07.2021 - Current
Hadoop/ AWS EMR Admin
Cognizant Technology Solutions
07.2019 - 07.2021
Hadoop Administrator
Tata Consultancy services
07.2015 - 07.2019
Bachelor of Engineering - Computer Science And Engineering
Samrat Ashok Technological Institute
Similar Profiles
Francisco Javier Chavero, Jr.Francisco Javier Chavero, Jr.
Environmental Program Manager (EPM) at Amazon Web Services (AWS), Amazon Data Services, Inc.Environmental Program Manager (EPM) at Amazon Web Services (AWS), Amazon Data Services, Inc.
Manish KulshreshthaManish Kulshreshtha
Head - Enterprise Support (Mid and Large Enterprise Business) at Amazon Web Services (Amazon Internet Services Pvt. Ltd.)Head - Enterprise Support (Mid and Large Enterprise Business) at Amazon Web Services (Amazon Internet Services Pvt. Ltd.)
Robert GoodwinRobert Goodwin
Global Lead, Specialist Solutions Architect WWPS Secure Hybrid Cloud at AMAZON WEB SERVICES AMAZON INCGlobal Lead, Specialist Solutions Architect WWPS Secure Hybrid Cloud at AMAZON WEB SERVICES AMAZON INC
Christopher TiceChristopher Tice
Generator Technician at AWS, Amazon Web ServicesGenerator Technician at AWS, Amazon Web Services
RJ JEEVAN PRAKASHRJ JEEVAN PRAKASH
Audit Executive at KPMGAudit Executive at KPMG