Vamshi Vedantham

Project Description: Worked for Launch Consulting Group as a Data Architect. This is a Data Migration project for a Magna Legal Services Firm. The business requirement of this project is to migrate and transform the data from Various on-premises Systems including to SQL Managed Instances to ADLS using ADF and Azure Synapse analytics.Expertise in implementing end-to-end data integration, analytics, and governance solutions using Microsoft Fabric to drive business insights and decision-making.

Roles and Responsibilities

• Skilled in configuring and managing Data Pipelines, Lakehouses, and Real-Time Analytics within the Microsoft Fabric environment to optimize data flow and processing.
• Proficient in leveraging OneLake for unified data storage and enabling seamless collaboration across data engineering, analytics, and visualization teams.
• Designing and implementing scalable data architecture frameworks for enterprise-level applications, ensuring seamless integration with Microsoft Fabric and cloud platforms.
• Proficient in building ETL/ELT workflows, optimizing data models, and ensuring high performance for analytics workloads in modern data ecosystems.

Project Description: Worked for Centific Global Solutions as a Data Modeler for a giant client in US in logistics domain. This is a Data Migration project involving moving the functionality of the legacy application to modern databases. The business requirement of this project is to automate the migration and transform the data from Various on-premises Systems including Azure SQL, Cosmos DB to ADLS and Azure Synapse analytics using ADF.

Roles and Responsibilities

• Supported business intelligence initiatives by constructing dimensional models optimized for reporting purposes.
• Spearheaded cost optimization strategies by evaluating the impact of design decisions on system performance, scalability, and maintenance requirements.
• Assisted in the migration of legacy systems to modern platforms, ensuring seamless data transfer and minimal downtime.
• Collaborate with ETL developers to design efficient Extract, Transform, Load (ETL) processes for data migration, integration, and transformation. This involves understanding source data structures, mapping data between different systems, and ensuring data consistency.
• Implement data validation rules and constraints to ensure data quality and integrity. Perform data profiling and cleansing activities to identify and rectify inconsistencies or errors in the data.
• Data Integration & Transformation: Designs, builds, and manages data pipelines using Microsoft Fabric, integrating data from various sources like Azure Data Lake, Synapse, and Power BI.
• Lakehouse Architecture & Optimization: Implements and optimizes lakehouse architectures using Fabric’s OneLake, Delta tables, and Spark-based processing for efficient storage and querying.
• Security & Governance: Ensures data security, compliance, and governance by managing access controls, implementing data policies, and monitoring performance within Fabric’s unified analytics environment.

Project Description: Worked for Capgemini India Private Limited as a Lead Azure Data Engineer. This is a Data Migration project involving internal applications like HR, Sales, Finance and Delivery. The business requirement of this project is to automate the migration and transform the data from Various on-premises Systems including SAP BO (Business Objects) to ADLS and Azure Synapse analytics.

Roles and Responsibilities

• Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
• Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
• Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
• Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors.
• Evaluated various tools, technologies, and best practices for potential adoption in the company''s data engineering processes.
• Collaborated with cross-functional teams for seamless integration of data sources into the company''s data ecosystem.
• Established robust monitoring processes to detect system anomalies.
• Collaborated with system architects, design analysts and others to understand business and industry requirements.

Project Description: Worked for Lenovo India Private Limited as a Data Infrastructure Engineer. This is a Data Migration project. Business requirement of this project is to migrate and transform the data from Various on-premises Systems including Lotus Notes to ADLS and Azure Synapse analytics.

Roles and Responsibilities

• Developing the Framework to transfer data from Lotus Notes as Source system to Staging and then to Production.
• Creating Pipelines and Linked services to execute data migration.
• Writing data transformation logic in data bricks.
• Debugging data level issues in pipeline failures.
• Involved in User Acceptance Test with business users.
• Responsible for troubleshooting the errors that occurred while executing the framework.
• Involved in the continuous enhancements and fixing of framework related problems.
• Attending meetings with stakeholders and prioritizing the tasks.
• Analyzing the data and developing the reports.
• Worked for Data migrations from one system to another system.
• Involved in data modelling.
• Scheduling and prioritizing the reports.
• Connecting with business team to understand the requirements.
• Clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data to our feature developers and business analysts.
• Maintaining the SQL SERVER Agent Jobs
• Maintaining the ETL Packages that pulls data from Lotus Notes as Source System
• Also learned about DynamoDB and Azure DevOPS.
• Worked on API’s written in Python and C# in pulling the data from LotusNotes as source system.
• Maintaining the health status of the Production Server.
• Performance Tuning and Optimization of the SQL SERVER Database.
• Ensuring that the SSIS Package is running optimally.
• Ensuring that Automation is in place.

Project Description : Worked as SQL SERVER DBA Consultant for Epredia which is separated from ThermoFisher as a Business Intelligence Consultant and Automation Expert.

Roles and Responsibilities

• Worked with manager and supervisor in SSIS packages.
• Integrating data from multiple systems and pumping data to Epredia Systems.
• Create Scala/Spark jobs for data transformation and aggregation.
• Produce unit tests for Spark transformations and helper methods
• Write Scala doc-style documentation with all code
• Design data processing pipelines
• Automating the SSIS and CUBE Processing’s.
• Analyzing the data and developing the reports.
• Worked for Data migrations from one system to another system.
• Involved in data modelling.
• Scheduling and prioritizing the reports.
• Connecting with business team to understand the requirements.

Project Description : \Worked as Migration Consultant and SQL SERVER DBA for a team of 4 for HarperCollins Publishing co. New York, United States.

Roles and Responsibilities

• Responsible for creating the pipelines to load data from flat files Azure SQL database.
• Writing shell scripts to move the files from external systems to Azure Data Lake Storage using ADF Components.
• Writing T-SQL programs to transform data
• Involved in designing End to End flow of the system.
• Involved in creating Test Cases as well as Unit testing.
• Involved in User Acceptance Test with business users.
• Responsible for troubleshooting the errors for the production group.
• Worked on migrating SQL SERVER 2000, 2005, 2008/2008R2, 2012, 2014 Versions to SQL SERVER 2016.
• Worked closely with different stakeholders to make sure all the tests are through.
• Worked on PowerBI for analytics.
• SCRUM Master for Industrial Badger App (IBA)

• Developed custom database objects, stored procedures, and delivered application support.
• Maintained complex T-SQL queries, views, and stored procedures in multi-database environment with little supervision.
• Created optimal technical solutions to user needs with in-depth system analysis.
• Followed standard practices for migrating changes to test and production environments.
• Designed and implemented TSQL queries for reporting and complex solution development.
• Learned greatly about Python Programming from Manager and Modelling from Modellers.
• Implemented robust monitoring tools to proactively identify potential bottlenecks and address issues before impacting end users.
• Training the team technically, Project Management and SCRUM methodologies

• Developed custom database objects, stored procedures, and delivered application support.
• Maintained complex T-SQL queries, views, and stored procedures in multi-database environment with little supervision.
• Created optimal technical solutions to user needs with in-depth system analysis.
• Followed standard practices for migrating changes to test and production environments.
• Managed workload independently but collaborated with colleagues to complete larger scale tasks in distributed team environment.
• Designed and implemented TSQL queries for reporting and complex solution development.
• Installed, Configured, troubleshooting of Azure Compute instances, Azure Backup, Azure Storage Monitor, snapshot, Azure Storage
• Worked at L3 level on day-to-day operational issues, requests and project tasks involving various technologies e.g., Azure, Windows server, patching SQL SERVER.
• Responsible for providing senior level of support to the team, manage the escalated issues and requests from juniors adhering to SLAs.
• Experienced in creating high performance dynamic SSIS Packages and managing.
• Sound Experience in creating Parameterized tabular/ matrix reports, Charts, KPI’s.
• Sound experience in developing OLAP cube & writing MDX Queries/ Expressions.
• Responsible for creating, reviewing, and modifying various documentation, participate in CAB meetings, participate in on call duty 24x7.
• Maintained 33 Servers using IDERA Diagnostic Manager, IDERA Admin Toolset, Robocopy Command and SCOM 2007.
• Good in handling refreshes, Planned Maintenances, Applying Patches.
• Mentored new team members and shared the knowledge.

• Created new SSIS Packages and made modifications to the existing SSIS packages based on customer requirements for First Allied Securities Incorporation (FASI) San Diego, Los Angeles, US.
• Providing the reports that the financial consultants requests for by pumping the data from views to temporary views and then by creating indexes on the temporary views.
• Worked on Execution of the paths depending on the success, failure, or Completion of other tasks with precedence constraints and expressions to determine the workflow.
• Supported the existing massive ETL Processing called BDM (Brokerage Data Mart) that pull data from different vendor systems.
• Worked on development of End-to-End Orchestration using Azure Data technologies.
• Good exposure to SQL Functions, Sub Queries, Joins, Views, Materialized Views, Tables and External Tables.
• Experience in handling data level issues and analyzing the data.
• Mentored junior developers, fostering a culture of continuous learning and skill improvement.
• Collaborated with product managers to define technical requirements and develop innovative solutions for complex problems.
• Enhanced application performance by identifying bottlenecks and optimizing code.
• Reduced system downtime with proactive monitoring, timely troubleshooting, and efficient issue resolution.

• Worked with 2 Projects at Virtusa Consulting.
• Worked in Analysis Phase, Requirements gathering phase and creation of SSIS packages based on Customer requirements and testing them thoroughly for UAT for Arts & Entertainment (A&E) Client.
• Deployed to Broadridge Financial Services and worked for Pershing Client, Australia (ASX Australian Stock Exchange) who is into Brokerage Services as an SQL SERVER Developer.
• Designing databases and ensuring their stability, reliability, and performance.
• Design, create, and implement database systems based on the end user's requirements.
• Improve application's performances.
• Prepare documentation for database applications.
• Memory management for database systems.
• Develop database schemas, tables and dictionaries.
• Ensure the data quality and integrity in databases.
• Fix any issues related to database performance and provide corrective measures.
• Create complex functions, scripts, stored procedures and triggers to support application development.
• Take regular database backup.
• Test databases and perform bug fixes.
• Provide authentication and authorizations for Database.
• Develop best practices for database design and development activities.

Project Description : Creating Full/Incremental/Daily Loads and support all scheduled ETL jobs for batch processing for 140 Customers across US for GE Healthcare, Burlington, Vermont, US.

Roles and Responsibilities

• Created the automated processes for the activities such as database backup processes and SSIS Packages run sequentially using SQL Server Agent job. Resolving the reporter issues on thick client that is installed on the customer’s end users machine.
• On-Call support to esteemed customers to resolve issues for business requirements.
• Good in solving request cases such as adding fields to Fact and Dimensions as requested by the customer and make sure that the field(s) is backfilled per customer’s request after adding them in reporting layer
• Good in handling the Scheduled Jobs (Reports that trigger after the ETL Process completion) & Web Dashboards using Cognos and Precision BI as reporting tools.
• Identifying the corrupted Scheduled Jobs and Dashboards that are post load activities and bringing them back to track.
• Writing basic shell scripts to transfer the files from the InterSystems cache that works on wide variety of operating systems.
• Created SSIS packages for File Transfer from one location to the other using FTP task.
• The packages created included a variety of transformations, for example Slowly Changing Dimensions, Look up, Aggregate, Derived Column, Conditional Split, Fuzzy Lookup, Multicast, and Data Conversion.
• Developed, deployed and monitored SSIS Packages for new ETL Processes and upgraded the existing DTS packages to SSIS for the on-going ETL Processes.
• Implementation and delivery of BI platform solutions to develop and deploy ETL, analytical, reporting and scorecard\dash boarding on SQL Server 2008/2008 R2 using SSAS, SSIS/DTS, SSRS and Power BI.
• Enhanced collaboration between technical teams and business stakeholders through clear communication of complex concepts in easily understandable terms.
• Managed end-to-end development lifecycle of multiple BI projects, ensuring timely delivery within budget constraints.
• Applied advanced statistical techniques to uncover hidden patterns and trends in data, providing valuable insights for strategic decision making.
• Collaborated with cross-functional teams to gather requirements and deliver tailored BI solutions for various business units.