Data Engineer with over 5 years of experience in designing, testing, and maintaining data management systems. Expertise in database design and data mining enhances business decision-making capabilities. Achievements include optimizing data retrieval processes and significantly improving system efficiency.
Overview
7
7
years of professional experience
Work History
QA Data Engineer
DILIGENT GLOBAL
Hyderabad
03.2024 - 02.2025
Collaborated with Product Owners to define features, write acceptance criteria, and iteratively groom user stories.
Supported testing of cloud migration projects involving AWS S3 and Athena for analytics workloads.
Designed and built scalable ETL pipelines for the ingestion and transformation of high-volume data using Snowflake and Python.
Validated data across Oracle DBs, data lakes, and Tableau dashboards to ensure end-to-end consistency.
Participated in agile development processes, contributing to sprint planning, stand-ups, and reviews to ensure timely delivery of data projects.
Partnered with data engineers and analysts to troubleshoot complex data discrepancies.
Maintained documentation for compliance audits and validation protocols.
Optimized existing queries to improve query performance by creating indexes on tables.
Developed and implemented Tableau dashboards to provide insights into business metrics.
Created complex reports using various types of charts and graphs to visualize data trends.
Created visual representations of product categories and relationships, using Tableau dashboards to highlight desired aspects of key financial and performance indicators.
ETL Developer / QA Analyst
Tyson Foods Inc
Bengaluru
09.2022 - 12.2023
Built ETL jobs for data migration and reporting using Snowflake.
Analyzed system requirements to create test cases.
Executed manual and automated tests in different environments.
Conducted functional and integration testing of ETL workflows.
Led data reconciliation initiatives between Oracle systems and the BI layer.
Worked with analysts to automate test cases and improve data quality.
Monitored performance of the ETL processes by creating log files with SSIS logging features.
Designed and developed stored procedures, functions, views and triggers using T-SQL for efficient data transformation.
Performed unit testing of all the mappings developed in the ETL layer before delivering it to production environment.
Optimized queries by analyzing query plans using SQL profiler tool.
Evaluated source systems data quality and identified opportunities for improvement.
Involved in creating database objects such as tables, views, indexes based on business requirements.
Developed and managed enterprise-wide data analytics environments.
Implemented best practices for optimizing the performance of Tableau reports and dashboards.
Performed unit testing on all created reports and dashboards prior to production deployment.
Assisted in designing and developing ETL processes to extract data from multiple sources into a single repository for analysis in Tableau.
Junior Data Engineer
Asseton technologies Pvt Ltd
Chennai
07.2018 - 02.2022
Assisted in the development of batch data pipelines and data cleansing.
Supported performance tuning and wrote complex SQL queries.
Participated in Agile ceremonies, and supported CI efforts.
Optimized existing databases for better performance by indexing columns or rewriting queries.
Created and optimized SQL queries to retrieve large datasets for analysis.
Maintained version control systems like GitLab and GitHub for tracking code changes.
Closely monitored data warehouse functionality and performance, proactively responding to issues.
Involved in migrating on-premise RDBMS to Snowflake EDW.
Interact with the business team and understand the use cases.
Interact with the Source team to understand feed structures, data volume, and frequency.
Design, develop, test, implement, and support data warehousing ELT.
Worked on bulk and continuous data ingestion using COPY SnowPipe.
Created internal and external stages, and transformed data during load.
Used core components, i.e., types of tables and cloning, time traveling, streams, and tasks.
Writing SnowSQL queries against Snowflake.
Developing scripts to extract, load, and transform data.
Worked closely with other team members to identify and remove software bugs.
Education
Bachelor of Technology - Electronics And Communication Engineering
GITAM University
Bengaluru
07-2017
Skills
ETL processes
Data warehousing and modeling
Data ingestion and quality
Oracle, SQL Server, and MySQL
Apache Airflow
Tableau
Snowflake
Version control with Git
Project management with JIRA
Python programming
AWS cloud services
Agile and Scrum methodologies
CI/CD practices with Git
Test automation strategies
Data compliance and migration
Data reconciliation
Project Highlights
Data Compliance Platform, Diligent Global, Developed compliant ETL workflows ensuring validation., Performed rigorous data testing and validation for audit readiness., Integrated monitoring with Tableau for stakeholder dashboards.
Customer 360 Platform, Tyson Foods Inc, Integrated multiple source systems into a unified customer view., Validated data lineage and transformation logic from ingestion to BI reports.
PROJECT HIGHLIGHTS
Built test frameworks to validate ingestion pipelines from external sources into Oracle, transformed with DBT, and reported via Tableau
Ensured traceability and audit readiness by maintaining comprehensive test cases, test evidence, and data lineage documents
Timeline
QA Data Engineer
DILIGENT GLOBAL
03.2024 - 02.2025
ETL Developer / QA Analyst
Tyson Foods Inc
09.2022 - 12.2023
Junior Data Engineer
Asseton technologies Pvt Ltd
07.2018 - 02.2022
Bachelor of Technology - Electronics And Communication Engineering
Part-Time Director (Education Consultancy) at Golden Diligent International AgencyPart-Time Director (Education Consultancy) at Golden Diligent International Agency