Venkatesh Narisetty

TCS

07.2022 - Current

Data Pipeline Development: Developed and managed end-to-end data pipelines using Apache Beam and Google Cloud Dataflow. Handled processing of large-scale datasets exceeding 1TB daily, ensuring high performance and low latency in data processing.
BigQuery Optimization: Designed and implemented data ingestion workflows into BigQuery. Optimized query performance by 70% through effective partitioning, clustering, and query rewriting techniques.
Data Integration: Integrated data from various sources, including on-premises databases, third-party APIs, and cloud storage, into a unified BigQuery warehouse. Enhanced data accessibility for analytics and reporting purposes.
Automation & CI/CD: Automated data deployment processes using Terraform and Jenkins, reducing deployment time by 40%. Established CI/CD pipelines to streamline updates to data infrastructure and ensure consistency across environments.
Monitoring & Troubleshooting: Set up comprehensive monitoring solutions using Google Cloud Monitoring (formerly Stack driver) and Logging to proactively identify and resolve data pipeline issues, leading to a 20% reduction in downtime.
Collaboration: Worked closely with data analysts and business stakeholders to translate business requirements into technical specifications. Developed custom SQL scripts to support ad-hoc data analysis and reporting needs.