Summary
Overview
Work History
Education
Skills
Accomplishments
Interests
Timeline
SoftwareEngineer
Anbu Ananda

Anbu Ananda

Senior Data Engineer

Summary

Senior Data Engineer with 10+ years of experience in the Google Cloud Platform (GCP) ecosystem. Specializes in BigQuery, Dataproc, Dataflow, Pub/Sub, Cloud Run, Cloud Functions, Big Data, and Python.


Engineered a data product for Ford to streamline customer data and enhance satisfaction using Dataproc for efficient data processing. Ensured data quality and automated alert generation using Cloud Functions and Cloud Run with Python. Orchestrated data pipelines with Airflow. Implemented Terraform for infrastructure provisioning and Tekton for CI/CD as part of IaC practices. Built a Financial Data Mart from the ground up on BigQuery.


Conducted technical interviews for Data Engineer positions. Developed insightful data visualizations and dashboards using Looker. Employed Python to validate, clean, and preprocess diverse datasets. Created custom data validation tools in Python and automated tasks.


Proficient in data warehousing concepts, Teradata, Oracle, SQL Server, and various data warehouse architectures (IBM-BDW, EDW, Teradata-FSLDM). Experienced in the Banking and Financial Services domain with a deep understanding of Credit Risk Analysis. Skilled in all phases of the Software Development Lifecycle (SDLC), including requirements analysis, design, and development. Extensive experience in writing reusable SQL scripts and Teradata macros for database validation and report testing.

Overview

10
10
years of professional experience
2
2
Languages

Work History

Senior Data Engineer

Ford Pro
09.2023 - Current
  • Engineered a data product for Ford to streamline customer data and enhance satisfaction
  • Leveraged Dataproc for efficient data processing
  • Utilized Cloud Functions and Cloud Run to ensure data quality and automated alert generation with Python
  • Orchestrated data pipelines with Airflow
  • Implemented Terraform for infrastructure provisioning and Tekton for Continuous Integration/Continuous Delivery (CI/CD)
  • Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.
  • Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
  • Participated in strategic planning sessions with stakeholders to assess business needs related to data engineering initiatives.
  • Championed the adoption of agile methodologies within the team, resulting in faster delivery times and increased collaboration among team members.
  • Designed robust database architecture that supported seamless integration of new datasets and facilitated rapid analysis capabilities.

Data Engineer2

Paypal
11.2021 - 09.2023
  • Build Financial Data warehouse / Mart on GCP Bigquery
  • Which sets GCP as a single source of Data for BI Reports
  • Develop Data warehouse / Mart in Biguqery
  • Migrate History Data from SAP / BW / PDW to GCP Bigquery
  • Build UC4 Workflows for incremental run
  • Schedule UC4 containers / JOBS in DALM
  • Build Symantic layer
  • Developed Bi Reports in Looker for End users
  • .Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
  • Led end-to-end implementation of multiple high-impact projects from requirements gathering through deployment and post-launch support stages.
  • Evaluated various tools, technologies, and best practices for potential adoption in the company''s data engineering processes.

Tech Lead

HCL Technologies
03.2021 - 11.2021
  • Data Mart Architecture
  • Lead the Data engineering Team
  • Developed Airflow pipelines
  • Optimized long running Bigquery SQL
  • Collaborated with product managers to define technical requirements and develop innovative solutions for complex problems.
  • Mentored junior developers, fostering a culture of continuous learning and skill improvement.
  • Reduced system downtime with proactive monitoring, timely troubleshooting, and efficient issue resolution.
  • Reduced system downtime, implementing robust monitoring tools and processes.
  • Negotiated with stakeholders to define project scopes and timelines, ensuring alignment with business goals.

Associate

Cognizant Technology Solutions
05.2016 - 03.2021
  • Increased customer satisfaction by resolving complex issues and providing exceptional service at all times.
  • Established strong relationships with key stakeholders, facilitating effective communication across departments and teams.
  • Manage offshore developer team. Guide team to solve the technical
    challenges. coordinate with on site team, capacity planning, iteration review, code review with
    product team, product line level review
  • Develop python based framework which eliminated manual effort and capable of performing
    data validation between On Prem & Cloud Data Mart
    Created utility to convert stored procedures, views and Teradata SQL to BQ
  • Extracted data from heterogeneous source system and used Python, Bigquery, BigSQL &
    Teradata for complex ETL transformation
  • Completed Terradata to Bigquery and Hadoop BIgsql to Bigquery migration

Associate Software Engineer

Accenture Technology Pvt Ltd
07.2014 - 05.2016
  • Developed Oracle to IBM DB2 & SQL Server to DB2 warehouse scripts
  • Designed and developed file parser
    Orchestrated pipeline using control-M
  • Collaborated with cross-functional teams to develop, test, and deploy high-quality software solutions for clients.
  • Participated in sprint planning sessions by estimating task complexity and prioritizing work items.
  • Gathered requirements and performed gap analysis through design workshops with users.
  • Authored code fixes and enhancements for inclusion in future code releases and patches.
  • Coordinated deployments of new software, feature updates and fixes.
  • Designed and implemented scalable applications for data extraction and analysis.

Education

B.Sc - Computer science

MGR College of Arts And Science
Hosur, India
05-2014

Skills

Cloud Data warehousing

Accomplishments

  • Received Spot & Bravo Award(s) from Paypal
  • Been a Client Champion in CTS
  • Received Ace - Accenture Center of Excellence Award

Interests

I love Personal Finance and Growing my portfolio

Timeline

Senior Data Engineer

Ford Pro
09.2023 - Current

Data Engineer2

Paypal
11.2021 - 09.2023

Tech Lead

HCL Technologies
03.2021 - 11.2021

Associate

Cognizant Technology Solutions
05.2016 - 03.2021

Associate Software Engineer

Accenture Technology Pvt Ltd
07.2014 - 05.2016

B.Sc - Computer science

MGR College of Arts And Science

Similar Profiles

CREATE PROFILE
Anbu AnandaSenior Data Engineer