Venkat sai kumar K

Work History

LTI Mindtree

07.2022 - Current

Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
Designing the workflow for sending the mail by using the logic apps in Azure.
Automating on SQL DW Start and Stop using automation account and runbook
Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
Collecting the structured and semi-structured data from the different sources and after collecting the raw data,running the ETL pipelines to cleanse the data and convert it as per the business need.
Responsible for data ingestion, data cleansing, data standardization and data transformation.
Implementing various spark transformation and actions using Databricks on raw data as per the business requirement.
Involved in extracting data from traditional RDBMS to ADLS using Azure data factory.
Involved in the development of a well optimized ADF pipeline which has reduced the execution time by 30%

UST Global

10.2019 - 07.2022

Collaborated with cross-functional teams for seamless integration of data sources into the company''s data ecosystem.
Designed and implemented a data lake solution on Azure using Azure Data Lake Storage and Azure Data bricks to enable real-time data processing and analysis.
Developed data ingestion pipelines and data transformation workflows using Python.
Responsible for creating and maintaining data pipelines in Azure Data factory, Pipeline components such as Integration Runtime, Linked Services, Datasets and Activities.
Created nested pipelines with various triggering mechanisms. Transforming data with Azure Data Flows.
Developed Data bricks notebooks and Job Compute.
Optimized data pipelines for performance and scalability.
Implemented data quality checks and data validation routines to ensure accuracy and consistency of data

UST Global

10.2019 - 07.2022

Worked on PowerShell on Azure services by creating scripts (availability sets & Disks, VM Images, resizing Virtual machines, blobs and file shares.
Automated using powershell scripts VM stoppage, multiple Virtual machine creations
Working experience with Git and GitHub repositories
implemented Azure Active directory RBAC rules.
Worked on Azure Virtual Network multi-tier design with Subnets and Network Security Groups using powershell and Terraform
Having good Knowledge in Azure monitor, Azure activity logs, Azure backup report and application insights