As a Senior Software Engineer at Microsoft, extensive experience in database optimization, performance tuning, and managing large-scale Azure SQL DB infrastructures aligns directly with the requirements of the Microsoft Dynamics CRM (Data Services) Development Team. Work has consistently focused on enhancing application scalability, ensuring high availability, and driving significant performance improvements.
Key qualifications and experience relevant to this role include:
- Query Performance Optimization and Database Resource Utilization:Deep expertise in Query Performance Optimization for SQL Server (2012, 2016, 2017, vNext) and Azure SQL DB. This includes evaluating data from Query Store and DMV queries. Analysis of query plans of slow queries and telemetry from across several hundred thousand databases to identify a pattern of slow queries that are then fixed to improve performance across multiple databases.
Developed a Stats Feedback Mechanism for Dataverse customer databases to identify top CPU-consuming or timeout queries and update outdated statistics, reducing high CPU alerts caused by suboptimal query plans.
Proactive identification of query patterns that lead to CRIs and live site alerts, with regular analysis and deep root cause analysis to identify gaps in the Dataverse platform.
Contribution to COGS Reduction efforts by reviewing workload patterns causing high CPU and memory utilization on Pools, working with respective feature owning teams to improve workload patterns, reviewing crashes, OOM scenarios, free space in data files, and shrinking to release space. This also includes optimizing the Dynamics Finance Platform to reduce TempDB pressure, resulting in a 3 TB reduction of TempDB space per day in the Dynamics FnO area, along with expertise in TempDB CTR.
Optimized key Dynamics CRM features such as Omnichannel, Quick Find, and Synapse Link, by closely collaborating with respective Feature owning teams to identify gaps and implement best practices and optimizations.
Identification of query patterns (antipattern queries) which could potentially cause performance bottlenecks to customers, applying auto-mitigations for such scenarios, and communicating to customers and Solution Architect teams for design changes.
Experience with Query Plan analysis and Outage Trend analysis.
Developed new features to reduce Log generation by Async Platform to reduce database level contentions.
Developed and optimized Deletion Service Platform code.
- Identifying and Addressing Long-Running Transactions (Cascade Delete/Assign):Experience in identifying and mitigating complex, long-running transaction patterns. Conceptualized and implemented the idea of reducing CPU pressure on high-density pools by proactively identifying and blocking queries that consistently time out but consume CPU resources during execution. This involved working with the SQL Query Processing team to expose a QDS hint to block high resource-consuming queries that never succeed.
Focus on resolving customer performance issues through telemetry analysis, wait stats analysis, and SQL plan analysis, enabling diagnosis and addressing cascading effects of long transactions, pushing towards more asynchronous and broken-down models.
- Piloting and Rolling Out Advanced SQL Features:Proven track record of piloting and rolling out advanced SQL features. Worked with the APRC team to expose a new feature in APRC to prioritize queries for plan forcing during high CPU scenario when APRC queue is full. Automation was deployed to submit queries to APRC more aggressively based on the new stored procedure exposed by the APRC team.
Achieved zero ICMs from Dataverse to the APRC team's ICM queue and exposed a new feature for prioritizing queries during high CPU scenarios. This experience directly translates to piloting and rolling out features like Batch Mode execution, Adaptive Join, and Memory Grant Feedback to CRM SQL Azure Databases.
Experience with optimized replay for performance validation.
- Collaboration with SQL Server Team on New Features:Close collaboration with the SQL Server team to evaluate and integrate new SQL Server features, exemplified by work with the SQL Query Processing team for QDS hints and the APRC team for query prioritization.
COGS Reduction efforts involve reviewing workload patterns and working with respective feature owning teams to improve them, including reviewing crashes, OOM scenarios, and free space, demonstrating an understanding of how new features can impact cost and performance.
In-depth knowledge of High Availability solutions, Hyperscale architecture, and processes for Forward and backward DB migration on Hyperscale.
- Dealing with Live Site Customer Issues and Telemetry:Highly experienced in dealing with live site customer issues, performing deep root cause analysis, and fixing product code to completely eliminate recurrence.
Performed deep root cause analysis on Azure SQL DB unavailability patterns, particularly servers with over 10 minutes of outage. Categorization and analysis of 10060 errors and SQL Crashes, working with the Azure SQL Availability team to reduce outage patterns, filing relevant bugs, and adjusting alerting thresholds.
Mitigation of customer performance issues reported through CSS and CRI channels by using various troubleshooting methods such as telemetry analysis, wait stats analysis, SQL plan analysis, query hinting, and indexing. Identified query sources from the Dataverse codebase, suggested changes to query generation patterns, and filed repair items based on common patterns with suggested optimized changes to respective Feature owning teams.
Co-developed a Self-Healing Platform for the Dynamics CRM environment, which reduced manual intervention by 50% and auto-mitigated over 9000 ICM alerts per month, demonstrating commitment to robust solutions and enhanced telemetry for faster diagnosis.
Extensive experience managing over 4.5+ million databases across the cloud-based Dataverse platform for Dynamics CRM and FnO, optimizing performance, and resolving critical live site issues makes for an ideal candidate for this role within the Microsoft Dynamics CRM (Data Services) Development Team.