Development Manager
- Led migration to cloud-based infrastructure, improving scalability and performance of multiple projects.
- Developing ETL pipelines using Azure Databricks, Spark Scala and Python
- Setting up and configuring Azure Databricks clusters.
- Creating and managing jobs and workflows using Azure Databricks notebooks and scripts.
- Troubleshooting and optimizing Azure Databricks performance and resource utilization.
- Streamlined deployment process, enabling quicker release cycles and enhanced product stability.
- Gathering the business requirements and understanding various business logics.
- Good knowledge in Hive/Impala and Internal/External tables, Partitioning, Bucketing, Joins Optimization of SQL's
- Creating and modifying the SQL objects like Stored Procedures, Functions, and Views T-SQL Queries as per the requirements
- Good working knowledge of performance tuning of Stored Procedures, T-SQL Queries & Implementing SQL Server Indexing
- Wrote T-SQL procedures to generate DML scripts that modified database objects dynamically based on user input
- Scheduling and monitor various jobs using Airflow
- Involved in fixing Production issues and Coordinating with the QA team and resolving the issues
- Good multi-tasking skills with flexible timings and good communication skills.