VISHNU HARITAS KOWTAL
BENGALURU
Summary
Methodical Senior Data Engineer with excellent Hadoop Administration skills. Skilled in implementing new Hadoop services/tools and managing large Hadoop clusters. A meticulous and dedicated admin with 6+ years of successful industry experience in Finance/Banking Domain.
Overview
6
6
years of professional experience
Work History
Senior Data Engineer
Altimetrik
Chennai
02.2023 - Current
- Leading a team of six for more than a year for multiple projects where user session data is processed in hadoop and generate reports on daily basis for C-level executives.
- Developed and implemented multiple alert systems as per user/operations requirement using shell script.
- Experienced in usage of monitoring tools such as Splunk and Grafana
- Analyzed complex platform issues and worked on Job tuning and business-critical applications
- Automated cluster metric collection such as fetching list of 777 owned files, Inode count & Capacity stats.
- Documented technical processes for team collaboration and knowledge sharing.
- Collaborated with clients to determine the requirements and implement the same for better cluster performance
- Performed capacity planning to ensure optimal usage of available resources in the cluster.
Senior Software Engineer
Ness Digital Engineering
Bengaluru
09.2021 - 01.2023
- Documented & provided RCA post resolution of production issues.
- Experienced in handling issues related to Spark, TEZ and Map-R job frameworks.
- Platform/Infrastructure level bugs or issues were resolved by working alongside Cloudera support concerned stakeholders.
- Maintained flexible schedule, responded post business-hours and provided weekend support.
- Periodical access and health checks on both node and service level were done using Ambari.
- Installed python packages as per user requirement on various edge nodes.
- Implemented security measures to protect sensitive data from breaches.
- Collaborated with cross-functional teams to ensure seamless integration.
Technology Analyst
Infosys Pvt Ltd
Hyderabad
01.2018 - 08.2021
- Implemented, developed and tested Analytical tool upgrades for Datameer, Arcadia and Rstudio.
- Lead for North American based bigdata clusters (Dev, UAT and Prod)
- Primary lead for multiple COB (Continuity of Business) tests across several clusters with 100% success rate
- Diagnosed and resolved multiple Spark & MapR job related issues/failures.
- SPOC for implementation of LDAP authentication scripts across clusters via RLM tool.
- One of the primary lead for implementing TLS Encryption across clusters.
- Worked on Cluster health Issues and automated daily cluster health checks for cluster services.
- Documented new upgrades by working with Engineering team.
- Experienced in the role of shift lead and point of contact for escalations and production Issues/Client calls.
Education
Bachelor of Engineering -
Dayananda Sagar College of Engineering
High School -
Kendriya Vidyalaya Sangathan
Skills
- Shell Scripting
- Database Administration
- Analytical Tool Upgrades
- System Testing
- Application Configuration
- User Support
- Disaster Recovery
- Performance Tuning and Optimization
- Resource Allocation
- Permissions and Access Control
- Troubleshooting & RCA
- MS Office & Excel
Accomplishments
- Documented and resolved SSO Plugin Issue via Ansible which helped to access CM and Analytical tools UI.
- Received Insta Award for excellence in LDAP script development and deployment across Clusters and leading multiple COB tests.
- One of the primary lead handling TLS Encryption and Cloudera Manager Upgrades across 50 Hadoop Clusters.
- Installed/Automated alert systems via shell script which resulted in reduced manual work and faster response in handling the issue.
- Received client appreciation for leading and completing Data catch up activity within SLA.
Timeline
Senior Data Engineer
Altimetrik
02.2023 - Current
Senior Software Engineer
Ness Digital Engineering
09.2021 - 01.2023
Technology Analyst
Infosys Pvt Ltd
01.2018 - 08.2021
Bachelor of Engineering -
Dayananda Sagar College of Engineering
High School -
Kendriya Vidyalaya Sangathan
Similar Profiles
Nandhakumar S. SelvarajanNandhakumar S. Selvarajan
Staff Engineer at AltimetrikStaff Engineer at Altimetrik
Sobhan GhoshSobhan Ghosh
Staff Engineer-Product & Platform Engineering at AltimetrikStaff Engineer-Product & Platform Engineering at Altimetrik
Aman KumarAman Kumar
Senior Software Engineer at AltimetrikSenior Software Engineer at Altimetrik