With over 8.5 years of expertise in the IT industry, I have developed strong skills in data analysis, data transformation, and building robust data pipelines. I am highly adaptable, dependable, and consistently demonstrate exceptional time management and organizational abilities.
KEY PROJECTS
Helped the client save approximately $2,000 every month by automating the enablement and disablement of SFTP connectivity on the storage account using Azure Automation.
Building a DevOps pipeline to automate the deployment of Databricks code using Azure DevOps.
Strengthened security protocols by eliminating public access and implementing a virtual network for Azure resources.
Introduced audit trails for enhanced tracking and compliance. Implemented logging within the existing Databricks codebase to seamlessly track errors.
Building KPIs for the most intensive CPU activities and long-running jobs of the DATAIKU tool
Establishing guidelines to utilize the Snowflake Warehouse efficiently, which will reduce costs, and training people on DATAIKU while providing the guidelines and best practices for using the DATAIKU tool.
Developed data service pipelines to automate quality checks across various datasets. Implemented Python-based quality check code, deployed on AWS Lambda, orchestrated using AWS Step Functions, and integrated flow logging with DynamoDB.
Established CI/CD pipelines in AWS using a serverless architecture.
Developed multiple interfaces and mappings for transferring data to third-party applications using Informatica Cloud.
Planning for the overall sizing required to handle the huge data load for data processing.
Develop Cloud Data Integration mappings to exchange data with REST APIs using the built-in cloud REST connector, and create a Monthly Billing report of tickets closed.
KEY PROJECT.
Utilized SQL to clean and preprocess raw data, ensuring high data quality and readiness for analysis in Tableau and other tools.
Worked with the BI Team to develop interactive and visually appealing dashboards in Tableau to display key metrics, trends, and data visualizations that supported business intelligence.
Performed ad hoc data analysis using SQL.