Harish Kumar

I hold significant responsibility for overseeing the comprehensive implementation and design process for esteemed Fortune 500 clients. Serving as a Subject Matter Expert, I am adept at promptly addressing and resolving any issues pertaining to Data Factory, ensuring a seamless and efficient production support experience. Additionally, I excel in managing and providing support for various Azure services, including Azure Data Factory, Azure Databricks, Azure Purview, and Stream Analytics. My expertise extends to PostgreSQL, IAM roles and permissions, and cloud infrastructure management. Moreover, I possess extensive knowledge of over 100 connectors for integration services.

A notable aspect of my work involves crafting robust ETL pipelines that seamlessly integrate Data Factory, Data Lake, Azure Databricks, Azure DB. Leveraging my proficiency and understanding of these technologies, I have designed Data Factory Pipelines and Data flows that precisely align with the unique requirements and objectives of our clients.

I have made a significant impact by successfully executing complex and critical migrations to Azure ADF, enabling organizations to modernize their data infrastructure, optimize data processing, and make data-driven decisions with speed and accuracy. My commitment to delivering timely and high-quality solutions has consistently benefited Microsoft customers.

• In dynamic and challenging environment, I provided comprehensive support for multiple Big Data implementations within banking sector. Leveraging expertise in Big Data technologies and proficiency in Python, I contributed to success of these projects by offering valuable insights and guidance.

Taking on responsibility of application support within expansive Big Data Ecosystem, I oversaw Data Testing and Data Ingestion phase, ensuring a seamless flow of data until it was successfully loaded into MapR DB and Elastic Search. To enhance our testing capabilities, I developed Python Code that effectively validated data residing in multiple folders. This code was subsequently employed in cluster environments using Apache Spark, where I wrote Spark scripts and created user-defined functions(UDFs) in Hive. In addition, I leveraged my expertise in Apache Drill, Elasticsearch, and Kibana to craft SQL queries and create visually compelling dashboard visualizations.

• In the domain of software development, I played a pivotal role in designing an Internal Application tailored to our esteemed clients' needs. As a leader within the responsibilities team, I spearheaded the ETL Testing Process, leveraging the capabilities of Numpy and Pandas libraries to ensure the highest quality and reliability within the Big Data Platform.
  
  In addition to my expertise in ETL Testing, I have extensive experience in conducting Batch ETL Testing and Mainframe Testing. My proficiency in these areas enabled me to effectively ensure seamless and error-free data processing throughout the entire data lifecycle.