Krishna Moulya

Over 6.2 Years of Experience in Data migration project with Azure Data Bricks, PySpark, ADF, Synapse Analytics, Data Lake store Gen2(ADLS Gen2), Azure SQL, power BI, snowflake Experienced in developing, implementing, monitoring and maintain the Data Warehouse extracts, transformations and ETL process in various industries like Healthcare and Retail. Experienced in data bricks notebooks, Loading data from ADLS to data frames Implemented transformations and partitions in data bricks Worked on delta files and incremental data loads. Developing notebooks and applying transformation using spark SQL in Azure data bricks. Testing the notebook and validating the scripts using SQL Experience in creating pipelines to load from one server to another using Azure Data Factory. Worked on activities like metadata, if, copy, foreach, lookup, etc in Azure Data Factory. Experience in creating incremental load pipeline using Azure Data Factory. Conversant with T-SQL coding including Stored Procedures, Functions, Views and Joins. Extracting the data from various data sources into Power BI desktop to generate Reports and Dashboards. Conducted in-depth analysis of client requirements, collaborating with stakeholders to understand data integration needs and business objectives. Designed end-to-end data integration solutions, outlining architecture, data mappings, transformations, and integration workflows tailored to meet client specifications. Led the development of Extract, Transform, Load (ETL) processes, ensuring efficient data extraction, cleansing, transformation, and loading from diverse source systems to target destinations. Conducted rigorous testing of data integration workflows, performing data validation, quality checks, and debugging to ensure accuracy and reliability. Identified performance bottlenecks and optimized data integration processes, enhancing system efficiency and reducing processing time by [percentage/metrics if available]. Acted as a liaison between technical teams and clients, providing regular updates, addressing concerns, and aligning deliverables with client expectations. Prepared comprehensive documentation including technical specifications, user guides, and training materials, facilitating smooth handover and knowledge transfer to client team

• Infomerica-Project#1, pwc(pepsico), EDF, Databricks, Datafactory, synapse, Implemented a comprehensive data integration and processing pipeline leveraging Azure Data Factory (ADF) across its first, silver, and gold stages. In the initial phase, utilized ADF to ingest data from various sources, ensuring seamless connectivity and efficient extraction. Transitioning to the silver stage, integrated Advanced Data Bus (ADB) to enhance data transformation capabilities, enabling streamlined processing and standardization of datasets. As the project advanced to the gold stage, integrated Synapse for advanced analytics and orchestration, empowering real-time insights and scalable data processing., Developed end-to-end data pipelines using Azure Data Factory, ensuring robust data flow from source to destination. Implemented ADB in the silver stage for advanced data transformation, including cleansing, enrichment, and normalization. Leveraged Synapse as the gold stage solution, orchestrating complex data workflows and facilitating advanced analytics. Conducted thorough Data Resilience Patterns (DRP) mapping to ensure data integrity and fault tolerance across the pipeline. Collaborated with cross-functional teams to gather requirements, design solutions, and optimize pipeline performance. Provided technical expertise and guidance in troubleshooting and resolving data pipeline issues, ensuring uninterrupted data flow. Documented pipeline architecture, workflows, and best practices for knowledge sharing and future reference., Azure Data Factory (ADF), Advanced Data Bus (ADB), Azure Synapse Analytics, Data Resilience Patterns (DRP), SQL, Python, Successfully delivered a scalable and resilient data integration and processing pipeline, significantly improving data accessibility, accuracy, and timeliness. Received commendation for effectively integrating Synapse for advanced analytics, driving actionable insights and informed decision-making.
• Infomerica: project#2, Moody’s, Led the implementation of an integrated data processing pipeline utilizing Azure Data Factory (ADF) as the first stage, Advanced Data Bus (ADB) for the silver stage, and Azure Synapse as the gold stage solution. The project involved integrating source data from Scorecard Power BI into a cohesive pipeline for comprehensive data processing and analytics., Established the foundational data ingestion framework using Azure Data Factory (ADF), ensuring seamless extraction and loading of data from Scorecard Power BI. Implemented Advanced Data Bus (ADB) in the silver stage for efficient data transformation, including cleansing, normalization, and aggregation, to prepare the data for advanced analytics. Leveraged Azure Synapse Analytics as the gold stage solution to orchestrate complex data workflows and facilitate real-time analytics, enabling quick and informed decision-making. Collaborated closely with stakeholders to understand requirements, design data models, and optimize pipeline performance to meet business objectives. Conducted thorough testing and validation to ensure data integrity and accuracy throughout the pipeline, adhering to best practices and data governance standards. Provided ongoing support and maintenance, troubleshooting issues and optimizing performance to ensure uninterrupted data flow and analytics capabilities., Azure Data Factory (ADF), Advanced Data Bus (ADB), Azure Synapse Analytics, Power BI, SQL, Python, Successfully delivered a robust and scalable data processing pipeline, enabling efficient extraction, transformation, and analysis of data from Scorecard Power BI. Demonstrated expertise in integrating multiple Azure services to create a cohesive and high-performing data solution, driving actionable insights and strategic decision-making for the organization.
• NUD -Project#, ADANI, synapse workspace, pyspark, Worked on coding PySpark in Databricks and loading data into Azure Data Lake. Creating, validating, Testing data loaded using notebook and validating the scripts using SQL. Created workspaces and ingestion of data using data frames from raw to enrich layers. Experience with SQL Server and T-SQL objects like triggers, Stored procedures, tables, table variables, user defined functions, views, indexes, CTEs, Jobs, Backups and Restore
• NUD -Project#, KINISI, Databricks, PySpark, Worked data bricks notebooks. Loading data from ADLS to data frames. Implemented transformations and partitions. Worked on delta files and incremental data loads. Developing notebooks and applying transformation using spark SQL in Azure data bricks. Testing the notebook and validating the scripts using SQL.
• DATAFABRIC, Understanding the latest azure service fabric and its usages, trainings attended. Working on Auction management system use case.
• LTI - Project #, Campbell soup company, ADF, DEVOPS, Campbell Soup Company: Campbell's, is an American processed food and snack company. The company is most closely associated with its flagship canned soup products; however, mergers and acquisitions. It has grown to become one of the largest processed food companies in the U.S. with a wide variety of products under its flagship. It is headquartered in Camden, New Jersey, Experience in designing ADF pipeline for ingestion of data from SAP(HANA) to snowflake tables. Worked on activities like metadata, if, copy, for each, lookup, etc in Azure Data Factory. Experience in creating incremental load pipeline using Azure Data Factory.
• LTI - Project #, Viatris(Mylan) Global Pharmaceutical, ADF, Azure SQL DW, DevOps, Azure Blob, Azure SQL, Viatris Inc. is an American global pharmaceutical and healthcare corporation headquartered in Canonsburg, Pennsylvania. The corporation was formed through the merger of Mylan and Upjohn, a legacy division of Pfizer, on November 16, 2020, In Data migration project with Azure ADF, Synapse Analytics, Data Lake store Gen2(ADLS Gen2), Azure SQL. Prepared documents for coding standards and dmvp. Designed Azure ADF pipelines to move data from blob to blob and to Azure Data Lake Gen2. Developing notebooks and applying transformation using spark SQL in Azure data bricks. Testing the notebook and validating the scripts using SQL. Implemented activities Copy activity, Execute Pipeline, Get Meta data, If Condition, Lookup, Set Variable, Filter, For Each pipeline Activities for On-cloud ETL processing. Used dataflows for transformations and notebooks for data validations. Designed dashboards visuals with slicers, filters, drill through options. Followed agile scrum during projects. Implemented CICD for code migration to other environments.
• LTI - Project #, an American Fortune 500 company and global supplier of paints, coatings, and specialty materials (PPG), Synapse Studio, Dedicated SQL, DevOps, ADLS gen2, Power BI, Understand the user story and create tasks in agile scrum process. Created pipelines to load data from SQL server databases to ADLS gen2(parquet) in synapse studio. Load the files to stage tables and then to data warehouse tables in dedicated SQL pool in synapse. Writing views, stored procedures for transformations to load data from stage tables to Data warehouse tables. Preparing views data, data models for PBI reports. Converting views to external tables used by PBI direct query for faster retrieval. Develop Power BI Reports & Effective Dashboards after gathering and translating End-User Requirements. Worked with both Direct query and Import data in to Power BI for creating Reports. Providing security by using Row Level Security (RLS) implementation.
• LTI - Project#, a large retailer based in Grand Rapids(Meijer), Azure ADF, Azure SQL DW, DevOps, Azure Blob, Azure SQL, Designed Azure ADF pipelines to move data from SAP BW Open hubs to Azure Data Lake Gen2. Implemented activities Copy activity, Execute Pipeline, Get Meta data, If Condition, Lookup, Set Variable, Filter, For Each pipeline Activities for On-cloud ETL processing. Used dataflows for transformations and notebooks for data validations. Designed dashboards visuals with slicers, filters, drill through options. Followed agile scrum during projects. Implemented CICD for code migration to other environments.