Yogesh Garg

Project : WREF

Client : Pharma Client

Project Description : We oversee the WREF data integration platform, powering 45+ dashboards for reporting needs. Our role involves collecting, cleansing, and transforming data from diverse sources to meet specific business requirements. Leveraging Azure data services, we maintain and manage this integration platform, ensuring seamless availability of refined data to our Power BI team for reporting purposes.

Tools And Technology used : Databricks, Pyspark, ADF, ADLS GEN, Rest API ,Logic Apps, SQL

Roles & Responsibilities:

• Providing Single data integration platform for various dashboard reporting
• Managed migration of database from SQL to Databricks Lake house.
• Developed ETL processes using Azure Data Factory,logic Apps, Databricks, Data lakehouse to ingest, transform, and load data from various sources.
• Manage Azure data services and Databricks platform like new cluster creation, cluster pools and attach existing clusters to the pool in DB and manage workflows & scheduling the pipelines in Databricks.
• Collaborated with product owner and cross-functional teams to understand business requirements and translate them into technical solutions.
• Managing Team of 10 data engineers.

Project : NOC operation data management for Colt

Project description : Our project involves daily extraction of ticketing data from the Sibel Ticketing tool utilizing APIs, along with network logs sourced from various vendor-specific network management systems. This data is systematically stored in Azure Data Lake Storage (ADLS). Our primary objective is to process this data in alignment with business requirements, facilitating the generation of essential reports such as SLA reports, outage reports, and assessments of device performance across different vendors. Additionally, we compile network availability reports to ensure comprehensive insights into network operations.

Tools And Technology used : Databricks, Pyspark, ADF, ADLS GEN,Spark SQL,SQL.

Roles & Responsibilities:

• Developed data pipelines using ADF, Azure Databricks and pyspark for data engineering tasks, including data ingestion, transformation, and loading.
• Managing business rules, standardization, reference management, and ensuring clean and updated data for downstream consumption.
• Handle the requirements from scratch i.e., requirement gathering, solution design, providing required ETAs, and then, complete course of development and documentation.
• Coordinate with various NOC team and support groups to provide continuous service to business users and for implementing the system enhancements.
• Create complex SQL queries to bring out the extracts of data from multiple
  tables / schemas/databases with defined and required transformations, conditions ,and rule sets.

• Performed manual testing on lightsoft NMS application.
• Reviewed technical design documents to ensure all requirements are met.
• Identify all performance bottlenecks and work with Support and Infrastructure Teams collaboratively on resolution.

• Performed testing for ULDC project and verified solution design.
• Created test scripts to manage automated feature testing using Python Optimized test cases to maximize success of manual software testing.
• Developed new methods of automation for existing processes and analyzed complex problems and formulated creative solutions.

• Developed MPLS-TP technology based EPT network for Bharti Airtel using Ciena Carrier Ethernet switches(CES) Devices 5160,8700 and access device 6200(support Ethernet & SDH)
• Implement the software up gradation of network elements as per customer requirements and traffic Migration from another network to Ciena Network
• Interaction with customers to troubleshoot and repair complex circuits, hardware faults.

• Validate performance of various L2 services like ELAN, ELINE, E-TREE services on different devices in the lab.
• Validate performance and specification functionality of devices LTS, GTS,GX devices before every new release.

• Validate performance of various L2 services like ELAN, ELINE, E-TREE services on different devices in the lab.
• Work closely with the vendor team to investigate test failures and issues logged during testing and report defects to vendor team.