VINEESHA CHAKKA
Hyderabad
Summary
Experienced Data Engineer with a track record in designing and implementing robust Data Warehouse solutions using Snowflake, Microsoft Azure, and Databricks. Proficient in integrating and transforming data from diverse sources such as CRM, ERP, Marketing tools, APIs, Databases and SharePoint. Skilled in ETL processes, data modeling, and developing BI dashboards. Expertise includes utilizing Snowflake, DBT, , Azure Data Factory, Python, SQL Server, Azure DevOps, Databricks, Power BI, and Tableau and CI/CD pipelines. Recognized for strategic data architecture designs and modeling techniques, consistently delivering rapid value to cross-functional teams
Overview
3
3
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Merilytics
03.2023 - Current
- Data Architecture and Warehouse Design: Designed a scalable enterprise data warehouse on Snowflake, establishing it as unified source of truth with standardized data ingestion processes.
- Data Pipeline Development: Implemented robust data pipelines using ETL tools such as DBT, Azure Data Factory, and Airflow to ingest data from multiple sources into Snowflake.
- Data Transformation and Management: Utilized DBT for primary data transformations, including creating models, macros, and managing Slowly Changing Dimensions (SCDs) to maintain data integrity and accuracy.
- Snowflake Administration and Optimization: Managed Snowflake administration tasks, including warehouse configuration, role management, user permissions, and database performance optimization.
- Data Governance and Auditing: Implemented thorough auditing processes to ensure data integrity, governance, and reliability across the data pipeline and warehouse.
- CI/CD Pipeline and Automation: Built and maintained a CI/CD pipeline using GitHub Actions for seamless deployment of data pipelines and transformations into production environments.
- Operational Efficiency and Automation: Automated data ingestion processes, significantly reducing manual effort by 80% and enhancing operational efficiency across teams.
- Real-time Streaming Analytics: Developed a real-time streaming pipeline for near-instant analytics, enabling timely decision-making and data-driven insights
- Leadership and Guidance: Led a team of junior data engineers, providing mentorship and support in technical skill development and project execution.
Data Engineer
Merilytics
08.2021 - 03.2023
- Orchestrated the creation of an Azure-based data warehouse from inception, configuring VMs, SQL servers, Logic Apps, Data Factories, and Key Vaults.
- ETL using Azure Data Factory: Developed dynamic data pipelines in Azure Data Factory for automated data extraction from 14 diverse sources with incremental load capabilities
- Implemented data quality checks and standardization using dynamic SQL stored procedures and Azure Data Flows.
- Incremental Data Processing: Utilized Databricks Notebooks to detect incremental records for data sources performing daily cumulative loads, optimizing data processing efficiency.
- Azure Automation and Python Scripting: Developed Python scripts within Azure Automation Account to automate data ingestion from APIs, enhancing data acquisition reliability and efficiency.
- Automation and Monitoring: Automated daily data refresh cycles with triggers and integrated real-time pipeline failure alerts using Azure Logic Apps
- Conducted comprehensive audits via Azure Data Factory, ensuring data integrity throughout the data warehouse lifecycle, including Power BI dashboard refresh.
- SQL Server Optimization: Optimized SQL Server performance by creating and optimizing stored procedures, resulting in an 80% reduction in query runtime.
- Dashboard Development: Proficiently designed and implemented Tableau and Power BI dashboards, delivering over 10 distinct dashboards tailored to meet specific client needs in the US.
- Azure Data Lake and Blob Storage (Gen2): Leveraged Azure Data Lake and Blob Storage (Gen2) for scalable data storage and processing, ensuring efficient data handling and management across the data lifecycle.
Education
BTech in Electrical & Electronics Engineering -
JNTUH College of Engineering
Hyderabad, India01.2021
Skills
- Python
- Snowflake
- Microsoft Azure
- Data Bricks
- DBT
- Fivetran
- SQL
- ETL Development
- Tableau
- Alteryx
- ADF
- CI/CD
- Azure DevOps
- GitHub Actions
Certification
SnowPro Core Certification (COF-CO2) by Snowflake
Personal Information
SENIOR DATA ENGINEER
Timeline
Senior Data Engineer
Merilytics
03.2023 - Current
Data Engineer
Merilytics
08.2021 - 03.2023
BTech in Electrical & Electronics Engineering -
JNTUH College of Engineering
SnowPro Core Certification (COF-CO2) by Snowflake
Similar Profiles
Sudhanshu SharmaSudhanshu Sharma
Business Associate at MerilyticsBusiness Associate at Merilytics
Ramesh BasakondaRamesh Basakonda
Data Analyst at MerilyticsData Analyst at Merilytics
Manish ReddyManish Reddy
Lead Analyst at MerilyticsLead Analyst at Merilytics