Tarun Veera Venkata Sairam Pothala
Bengaluru
Summary
Innovative Data Engineer with talent for designing and implementing robust data pipelines. Skilled in leveraging cloud platforms and big data tools to optimize data workflows. Strong ability to collaborate with cross-functional teams and deliver actionable insights. Committed to driving data-driven decision-making, enhancing data quality, and improving system performance.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Data Engineer
Cargill
Bangalore
02.2024 - Current
- Identified and rectified missing investment accounts, enhancing financial reports, and ensuring compliance and audit readiness.
- Optimised SQL queries and execution plans to enhance query performance by 50%.
- Spearheaded architectural discussions and delivered an optimal data quality pipeline framework using Informatica, enhancing scalability and minimising processing overhead by 25%.
- Revamped data quality framework across five financial systems, significantly enhancing dataset accuracy and reinforcing compliance for quarterly and annual financial reports.
- Implemented 75+ data quality rules, cutting upstream inconsistencies and ensuring reliable enterprise reporting.
- Orchestrated automated ETL processes using Lakeflow declarative pipelines, minimising manual intervention and enhancing pipeline reliability.
- Facilitated technical knowledge-sharing programmes on Databricks and Informatica training for over 35 engineers to enhance proficiency in modern data engineering practices.
Cloud Data Engineer
Siemens Gamesa
Bangalore
02.2022 - 02.2024
- Engineered end-to-end ingestion frameworks from Azure Synapse to Azure SQL DB to enhance data integrity and streamline performance.
- Enhanced pipeline security and authentication through integration of managed identities, private networking, Azure Key Vault, and OAuth2.
- Optimised PySpark queries through Z-ordering, caching, broadcasting, and Adaptive Query Execution to enhance data retrieval performance.
- Optimised Databricks write processes, achieving a 50% reduction in costs through coalescing, repartitioning, and delta optimisation.
- Spearheaded CI/CD pipelines for Azure Data Factory and Databricks, enhancing deployment efficiency and facilitating knowledge transfer with 15+ data engineers.
- Spearheaded design and deployment of an automated reporting framework using Azure Data Factory and SQL DB, delivering 30+ reports via SFTP and API on weekly, monthly, and yearly cycles.
Senior Engineer
Mindtree ltd
Bangalore
01.2019 - 01.2022
- Automated SQL script submissions via a metadata-driven PowerShell solution, minimising manual intervention by 40%.
- Migrated and modernised SSIS packages from on-prem SQL Server to Azure Data Factory to ensure continuity and performance of critical financial data pipelines.
- Implemented scd type-1 and type-2 strategies alongside full and incremental data loads to ensure accurate historical tracking and optimised performance of data warehouses.
- Designed and optimised ELT pipelines using SQL merge and Azure Data Factory to enhance data processing efficiency.
Education
Bachelor of Technology - Electronics and Communication Engineering
K L University
Vaddeswaram, IN-AP01-2019
Skills
- SQL programming
- ETL development
- Data warehousing
- Data pipeline architecture
- Azure Data Factory
- Databricks and PySpark
- SAP MDG and BRF
- Azure Datalake Gen2 and Key Vault
Certification
- Databricks certified Data Engineer Associate.
- Microsoft certified Fabric Data Engineer Associate.
Timeline
Data Engineer
Cargill
02.2024 - Current
Cloud Data Engineer
Siemens Gamesa
02.2022 - 02.2024
Senior Engineer
Mindtree ltd
01.2019 - 01.2022
Bachelor of Technology - Electronics and Communication Engineering
K L University