MOUNIKA METHUKU

As an L3 support member of the team, my responsibilities include, but are not limited to,

• Monitor, maintain, and provision components of the Data Systems Platform.
• Installing, configuring, and administering Ab Initio software and related technologies across various platforms.
• Perform software upgrades on the components of the Data Systems Platform.
• Work with the Data Engineering team to help design and implement the next iteration of scaling.
• Work closely with the systems performance, systems operations, and network engineering teams, as needed, to ensure high performance and availability.
• Work with the Data Engineering team to evaluate open-source and commercial software and hardware solutions.
• Develop and implement tools to automate aspects of managing the Data Systems Platform, including upgrades where appropriate.
• Participate in prototyping, proof-of-concept system development, and benchmarking.
• Manage storage restructuring as required.
• Participate in the on-call rotation, responding to alerts and system issues.
• Manage user access and resource allocations to the Data Systems Platform. Managing the Ab Initio environment, including user access, security, and metadata.
• Administer Kafka, HBase, Ab Initio, and Hadoop clusters to support data systems platforms.
• Review all Pull Requests for the team to ensure high quality and sustainable automation utilities for use in both cluster administration and for internal engineering clients.
• Develop automation utilities for infrastructure administration, as well as self-healing auto-response actions for common failures.

1. As an L2 and L1 support, I helped the team with:

a. Updating automated runbooks that were created for basic admin needs.

b. Create runbooks for repetitive asks from customers (created runbooks for Kafka topic deletion, head nodes decommission/recommission, and restart of services for the components in Hadoop).

c. Create alerts and dashboards for the applications, servers, and memory usage of the nodes.

d. Allocation and retraction of resources for the teams, and monitoring the usage.

e. Perform lease returns for all the servers on a time-period basis.

f. Documenting all administration tasks(Hadoop,Kafka,Hbase,Scylla,Abinitio), configurations, and procedures.

As an L2 & L3 support, my responsibilities were:

1. Upgraded Big data Systems:

• Contributed significantly to modernizing our infrastructure by implementing the latest versions, ensuring the system's stability, and performance.
• Performed an upgrade of Ubuntu 16.04 to 20.04.
• Helped the team in the dockerization of applications like Ab Initio, Hadoop, and Scylla.
• Involved in the upgrade of Hadoop 2 to Hadoop 3.

2. Upgraded Applications:

• Upgraded various applications, such as IronDB, Scylla, Kafka, Hive, Ab Initio, Hue, HBase, and Trino, to ensure performance and client functionality.
• Implementing and maintaining backup and recovery strategies for the Ab Initio environment.

3. Automation:

• Updated existing runbooks for accuracy.
• Created self-service runbooks for engineering teams.

1. Looking into regular L1 tasks, like:

• Creating, updating, and deleting Kafka topics.
• Increase or decrease resources to teams when needed.
• Decommissioning or recommissioning of nodes, when issues arise for data engineering teams.
• Debugging, troubleshooting jobs, and their logs on the servers.
• Updating puppet codes and creating cron jobs, as required.
• Diagnosing and resolving issues related to Ab Initio jobs, data flow, and performance.
• Installing, configuring, and administering Ab Initio software and related technologies across various platforms.
• Optimizing the performance of Ab Initio graphs and infrastructure, including identifying and resolving performance bottlenecks.

• I have helped the team with automating the basic asks of customers by using shell scripting.
• Gained experience with writing MySQL queries.
• Created alerts and dashboards for CPU, memory, and disk usage in Grafana and Prometheus.
• Managed tickets via Jira and change management.
• Monitoring, resolving, and escalating the alerts received.