Aniket Annam

Data Pipeline Innovations.

• Developed a MongoDB to MySQL CDC pipeline using Debezium, unifying real-time structured and unstructured data, reducing latency by 40%, and improving data accessibility for analytics.
• Successfully migrated the data warehouse from Redshift to BigQuery, ensuring the performance and integrity of all existing flows were maintained, while minimizing query costs.

Scalable Data Systems.

• Designed and implemented a dynamic query API service in Node.js, consolidating data-fetch endpoints into a unified, maintainable system, improving query efficiency.
• Architected a campaign management system that handles over 10,000 to 20,000 daily actions, with full audit trails.

Infra Optimization.

• Reduced redshift costs by 22% via query pattern analysis and ETL schedule restructuring, optimizing data warehousing expenses.
• Implemented a bulk action framework processing over 10,000 to 20,000 actions at a time.

Integrations

• Engineered and maintained daily sync pipelines for FB Ads (Graph API), Google My Business, and Google Ads, ensuring 99.8% SLA compliance, and reliable data ingestion.
• Successfully migrated the data warehouse from Redshift to BigQuery, ensuring the performance and integrity of all existing flows were maintained, while minimizing query costs.
• Worked on creating a query builder, which helped the user integrate and fetch data from the system without making an error. Optimizations and all will be considered by the system itself, by maintaining optimization techniques.
• Build campaign management endpoints, which helped user to create and update campaigns on bulk.