Venkata Chiranjeevi Gorle
GCP Data Engineer
Visakhapatnam
Summary
Data Engineer with 8+ years of experience transforming raw data into actionable insights, architecting scalable cloud solutions, and optimizing big data workflows. Specialized in migrating legacy systems to modern cloud architectures (GCP, AWS, Azure, BigQuery) with a keen focus on performance tuning and cost efficiency. Adept at designing high-throughput ETL pipelines using Apache Airflow, PySpark, AWS Glue, and DBT, ensuring seamless data flow across enterprise systems. Experienced in developing RESTful APIs and microservices using Flask and FastAPI for data integration, automation, and analytics delivery. Passionate about automating workflows, leveraging CI/CD (GitLab, Jenkins) for rapid deployments, and enforcing best security practices (IAM, GDPR, SOX). Excels in containerized environments (Kubernetes, Docker), enabling scalable and resilient data platforms. Thrives on solving complex data challenges, optimizing query execution, and implementing real-time monitoring with Prometheus and Grafana. A proactive innovator who turns technical bottlenecks into opportunities, bridging the gap between data engineering and business needs.
Overview
10
10
years of professional experience
Work History
Data Engineer
MassMutual
04.2025 - 10.2025
- Designed, built, and optimized data pipelines on GCP for processing large-scale datasets.
- Leveraged BigQuery, Cloud Storage, Cloud Functions, and Dataflow for efficient ETL workflows.
- Collaborated with cross-functional teams to migrate legacy systems to GCP with minimal downtime.
- Implemented IAM-based security policies and optimized resource utilization for cost efficiency.
- Developed RESTful APIs and microservices using Flask and FastAPI for data integration and automation workflows.
Data Engineer
Shell - Future Focus Infotech
03.2023 - 10.2024
- Optimized data quality and integrity by implementing robust data validation, profiling, and transformation techniques using Python and SQL on Snowflake, GCP, and AWS.
- Developed automated ETL pipelines using PySpark, Databricks, and pandas to streamline data ingestion and transformation, ensuring efficient real-time processing.
- Migrated legacy data systems to Snowflake and BigQuery, leveraging DBT for transformation and GitLab CI/CD for smooth deployment.
- Enhanced query performance and database efficiency through indexing, partitioning, and clustering, improving data retrieval speeds.
- Led cross-functional teams in designing scalable data architectures, integrating REST APIs, and improving cloud resource utilization.
- Established proactive monitoring and alerting mechanisms in GCP and AWS using Cloud Monitoring and Prometheus to ensure system reliability.
- Designed interactive dashboards in Snowflake and SQL to provide real-time business insights, improving data-driven decision-making.
- Tech Stack: Python, SQL, Snowflake, BigQuery, GCP, AWS, Azure, PySpark, Databricks, DBT, GitLab CI/CD, REST APIs, Prometheus
Data Engineer
State Street HCL Services
11.2021 - 03.2023
- Company Overview: Coimbatore, Tamil Nadu
- Designed and developed scalable data models supporting analytics and business intelligence, ensuring high availability and efficient querying.
- Automated data workflows using Apache Airflow, Kubernetes, and Databricks, reducing manual intervention and improving pipeline reliability.
- Led the transition from on-premises data storage to Snowflake and BigQuery, optimizing storage costs and query efficiency.
- Implemented CI/CD pipelines with GitLab for seamless deployment and version control, enhancing development efficiency.
- Enhanced system security by applying GCP IAM policies, ensuring compliance with GDPR and other industry regulations.
- Developed RESTful APIs for smooth data exchange across cloud platforms, enabling better system interoperability.
- Created real-time monitoring dashboards using Grafana and Prometheus, improving operational transparency and performance tracking.
- Tech Stack: Python, SQL, Snowflake, BigQuery, Apache Airflow, Azure Kubernetes, Databricks, GCP, GitLab CI/CD, REST APIs, Grafana, Prometheus
Data Engineer
Phoenix Group DMCC
01.2019 - 05.2020
- Company Overview: Dubai
- Designed and deployed hybrid cloud architectures on GCP, ensuring secure and seamless integration with on-premises systems.
- Migrated large-scale transactional databases to Cloud SQL and Firestore, enhancing performance and scalability.
- Developed automated data processing pipelines using PySpark and Dataflow, reducing latency in data transformations.
- Implemented Kubernetes-based containerization for scalable application deployment, optimizing cloud resource utilization.
- Established Cloud Composer workflows for orchestrating data pipelines, improving data processing efficiency.
- Applied advanced security policies using GCP IAM and Cloud VPN to safeguard sensitive data and ensure regulatory compliance.
- Monitored system performance and implemented optimizations using Cloud Logging and Prometheus, ensuring high availability.
- Tech Stack: GCP, Cloud SQL, Firestore, PySpark, Dataflow, Kubernetes, Azure Cloud Composer, Cloud VPN, Prometheus
Management Trainee
Karvy Stock Broking Ltd.
05.2015 - 01.2019
- Company Overview: Hyderabad, Telangana
- Managed large-scale data migrations from SQL Server to GCP, optimizing storage and reducing processing time.
- Built and automated ETL workflows using Apache Airflow and DBT, ensuring consistent and reliable data transformations.
- Enhanced database performance through query optimization, indexing, and partitioning strategies, improving data retrieval efficiency.
- Designed and implemented data lakes using Cloud Storage and BigQuery, enabling large-scale data analytics.
- Developed CI/CD pipelines using GitLab, automating deployments and improving development workflow efficiency.
- Established monitoring frameworks using Cloud Logging and Grafana to track system performance and troubleshoot issues proactively.
- Enforced security best practices by configuring GCP IAM roles and policies, ensuring compliance with industry standards.
- Tech Stack: SQL Server, BigQuery, Apache Airflow, DBT, Cloud Storage, Azure GitLab CI/CD, Grafana, IAM, Cloud Logging
Education
MBA - Capital Markets
NALSAR University
Hyderabad04.2015
Skills
Python
AWS Glue
PostgreSQL/MySQL
Timeline
Data Engineer
MassMutual
04.2025 - 10.2025
Data Engineer
Shell - Future Focus Infotech
03.2023 - 10.2024
Data Engineer
State Street HCL Services
11.2021 - 03.2023
Data Engineer
Phoenix Group DMCC
01.2019 - 05.2020
Management Trainee
Karvy Stock Broking Ltd.
05.2015 - 01.2019
MBA - Capital Markets
NALSAR University