Summary
Overview
Work History
Education
Skills
Publications
Certification
Timeline
Generic

Anjali Ajayan

Dubai

Summary

Data Engineering professional with 9 years of proven track record in developing robust data pipelines, database management, and cloud-based solutions.

Skilled in SQL, Python, and Spark, with strong focus on team collaboration and delivering impactful results. Adaptable and reliable, consistently meeting evolving project needs while fostering productive team environment.

Overview

9
9
years of professional experience
1
1
Certification

Work History

Data Engineering Architect

NetApp
07.2025 - Current
  • Successfully migrated data from a Tabular database to an AWS Glue Catalog-based Iceberg database, ensuring seamless business continuity and minimal downtime.

- Rewrote metadata files using predefined procedures to align with the new data location.

- Registered copied tables with the AWS Glue Catalog and refactored Spark transformations to integrate with the new architecture.

- Enabled table optimization in Glue using Airflow DAGs for enhanced performance.

- Ensured data integrity by implementing and executing a comparison DAG to validate data consistency between the source (Tabular) and target (Glue) databases post-migration.

  • Designed and implemented ETL pipelines and database schemas for activation workflows using Postgres and Data Lakehouse (DLH) technologies.
  • Developed and maintained dashboards to monitor data availability and ensure operational reliability.


Senior Software Engineer

NetApp
08.2022 - 06.2025
  • Lead python developer and data engineer for Keystone Services - a pay-as-you-go STaaS (Storage as a Service) offering that delivers a seamless hybrid cloud experience with significant global customer base
  • Migrated 9 TB of data from a time-series database to Tabular Data Lakehouse to help scale with the growing business needs
  • Developed schemas for Iceberg tables and ClickHouse DB utilizing SQL and Python to enhance data structure
  • Transformed raw data into insights using PySpark and Pandas/Polars, adhering to medallion architecture. Leveraged Trino query engine for accessing data from gold tables for reports and APIs
  • Developed Superset dashboards for data validation, enhancing operational efficiency in data operations activities.
  • Demonstrated strong focus on customer satisfaction through automation of daily performance reports via optimised Airflow DAG. This initiative resulted in significant developer time and optimised use of resources.
  • Led a team of 5 engineers in implementing a resilient testing mechanism that detected issues at an earlier stage in the pipeline. This proactive approach decreased the duration of QA test cycles by 3 days (~15% reduction) and enhanced the dependability and precision of the components.
  • Actively served as a project steering committee member involving global cross-functional teams, to understand project requirements and ensure timely releases adapting Agile methodology
  • Successfully recruited and mentored 10+ new team members, enhancing the organisation's capabilities and fostering team cohesion


Lead Software Engineer

NetApp
03.2021 - 08.2022
  • Project lead and backend developer for Fusion - a tool used to predict the performance metrics of storage systems for various NetApp products and OEMs application types (Python, FAST REST APIs, C)
  • Led the team towards successful quarterly releases by adding performance modelling support for all new ONTAP (storage OS) products and features
  • Drove end-to-end implementation of a significant feature in Fusion (Quotability). This improved tool usage by 20% and resulted in incremental sales.
  • Created a proof of concept (POC) for a simplified Greenfield sizer design with scalable modeling logic
  • Streamlined codebase for increased efficiency with regular refactoring and optimization efforts.
  • Developed secure applications by implementing industry-standard security practices and protocols (Blackduck scan).
  • Established coding standards across the engineering team to ensure uniformity in style and approach among all developers.

Software Engineer

NetApp
07.2017 - 03.2021
  • Enhanced API functionality through feature additions and improvements as backend developer for Fusion tool (tool to size and design configurations based on performance and capacity requirements).
  • Evaluated performance impacts of multiple ONTAP features (disk partitioning and data protection) and implemented them in Fusion.
  • Took ownership of advanced disk partitioning feature, resolving legacy issues and improving recommendation accuracy by 10%.
  • Achieved organizational recognition for rapid ramp-up and strong project ownership demonstrated.

Intern

NetApp
07.2016 - 06.2017
  • Contributed to a cross-functional project aimed at simplifying Application Provisioning Manageability
  • Programmed default templates using C and PHP for 5 different storage application types to make provisioning efficient for the customers

Education

MTech - CSE specialized in Cloud Computing

Vellore Institute of Technology
05-2017

BTech - Computer Science and Engineering

University of Kerala
05-2014

Skills

  • Python, SQL, PromQL, C/C, REST APIs (FAST API)
  • Data processing tools: Apache Spark, Apache Airflow, and Trino
  • Database technologies: Apache Iceberg(Tabular), AWS Glue Catalog, PostgreSQL, ClickHouse, MySQL, VictoriaMetrics (Prometheus),
  • Data visualization and orchestration: Apache Superset and Grafana
  • AWS platform experience
  • Experience with Docker deployment
  • Spark development, Database design, Data migration, ETL development
  • Virtualization tools: VMware Player, VMware Workstation, Oracle VirtualBox

Publications

Traffic Management in Cloud Data Centers, Anjali Ajayan, G. Anusooya, International Journal of Engineering and Future Technology, Vol.7, 2016, 51-57

Certification

Advanced Java Technologies,

C-DAC (Centre for Development of Advanced Computing)

Timeline

Data Engineering Architect

NetApp
07.2025 - Current

Senior Software Engineer

NetApp
08.2022 - 06.2025

Lead Software Engineer

NetApp
03.2021 - 08.2022

Software Engineer

NetApp
07.2017 - 03.2021

Intern

NetApp
07.2016 - 06.2017

MTech - CSE specialized in Cloud Computing

Vellore Institute of Technology

BTech - Computer Science and Engineering

University of Kerala
Anjali Ajayan