Cricket
MADDURI RAJ SEKHAR
Senior Data Engineer
Hyderabad,MH
Summary
Overall 17.5 years IT Experience Out of 6.5 years Experienced as Azure Data Engineer with hands-on experience designing, implementing, and managing data solutions on the Azure and SQL BI platform. Proven track record of delivering high-quality, scalable, and reliable data pipelines, data lakes, and analytical solutions to meet business needs. Skilled in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, and other Azure data services. Proficient in programming languages such as Python, SQL, and PowerShell for automation, data manipulation, and analytics. Strong understanding of data architecture principles, data modeling, ETL processes, and data warehousing concepts. Excellent problem-solving skills with a focus on optimizing performance and efficiency of data workflows. Experienced in working with cross-functional teams to gather requirements, architect solutions, and drive successful project outcomes.
Overview
15
15
years of professional experience
2
2
Certifications
3
3
Languages
Work History
Senior Data Engineer
OSB INDA PVT LTD
01.2023 - Current
- Working as Senior Data Engineer catering service in Data Governance and Quality using tools like Informatica Meta data Command Center and Data Governance Catalogue
- Projects worked: OSB Data Governance and Quality Tools Technologies: Informatica MCM, Informatica GDGC, Azure Synapse Analytics, Power BI Desk top, Dax Studio, Azure SQL,ADLSgen2,Azure Stream Analytics, Visual Studio, Power Shell, SQL, Azure SQL DW Role and Responsibilities Developed and implemented data governance frameworks and strategies using Informatica Data Governance tools to ensure consistent data management practices across the organization
- Implemented Informatica Metadata Manager to capture, store, and manage metadata information, including data lineage, data definitions, and data relationships, to enhance data transparency and lineage tracking
- Generated data lineage to showcase the stake holders about the Data Collaborated with cross-functional teams, including data architects, data analysts, and business stakeholders, to gather requirements, define data governance objectives, and communicate data governance initiatives and outcomes effectively
- Developed automated processes using PowerShell and Azure Automation to streamline data ingestion, transformation, and deployment tasks
- Designing and implementing scalable, high-performance data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.
Senior Azure Data Engineer
Wipro Technologies
01.2020 - 01.2023
- Working as Senior Consultant catering solutions in Azure Data Engineering with Power BI
- Projects worked: Zurich, Enbridge, T-Mobile, BenDikson, RSA Tools Technologies: Jira, ServiceNow, AZURE TFS, Git Hub, AZURE Data Factory, Power BI Desktop, Power BI Service Oracle SQL Developer, Jupiter Notebooks, AZURE Databricks, Micro Strategy, Power BI, SSIS, SQL, Azure Data Lake Gen2,Azure Synapse Analytics, AZURE Analysis, Service Role and Responsibilities Lead the design and implementation of end-to-end data pipelines for ingesting, processing, and transforming large volumes of data from diverse sources
- Architect and optimize data warehouse solutions to support advanced analytics, reporting, and business intelligence applications
- Mentor and guide junior data engineers in best practices for data engineering, software development, and system architecture
- Collaborate with data architects, data scientists, and business stakeholders to define data requirements and develop scalable solutions to meet business objectives
- Implement data governance, security, and compliance measures to ensure data integrity and regulatory compliance
- Implement Data Migration from Dynamic CRM Data verse to Azure portal Developing and maintaining data warehouse solutions on Azure SQL Data Warehouse or Synapse Analytics, ensuring data quality, reliability, and performance
- Integrating data from multiple sources, both on-premises and cloud-based, using technologies such as Azure Data Factory, Azure Logic Apps, and Azure Event Hubs
- Optimizing data storage and processing costs by leveraging Azure services like Azure Blob Storage, Azure Data Lake Storage, and Azure SQL Database
- Collaborating with data scientists to deploy machine learning models and incorporate them into data pipelines for real-time analytics and predictions
- Monitoring and troubleshooting data pipelines and data processing workflows to ensure reliability, availability, and performance
- Documenting technical designs, procedures, and best practices for data engineering processes and solutions
- Keeping abreast of the latest developments in Azure data services and best practices in data engineering to continuously improve our data solutions.
Lead Data Engineer
Yash Technologies
01.2018 - 01.2020
- Projects worked: PharAmerica Tools Technologies: ADF, SSIS, Power BI, DAX Studio, Mquery, Dynamics CRM, Power Apps, Azure ML, Kingsway soft, SQL Role and Responsibilities Designing and implementing scalable, high-performance data pipelines using Azure Data Factory
- Lead a team of Power BI developers, analysts, and data engineers, providing guidance, mentoring, and technical expertise
- Gathering data from various sources, which can include databases, spreadsheets, surveys, and APIs
- Creating Custom function to invoke ODATA feed, Mquery Created Business transformation in Power query Integrated Infragistics charts, Bean chart for visualization for stake holders Documenting technical designs, procedures, and best practices for data engineering processes and solutions.
Senior SQL BI
Prolific
01.2018 - 01.2019
- As Senior Power BI Consultant involved in handling Projects for Hudson Advisors in Banking and Finance domain
- Projects worked: Hudson Advisors Tools Technologies: SSIS, SQL, Power BI Role and Responsibilities Designing and implementing ETL processes to extract data from various sources, transform it according to business requirements, and load it into the target database or data warehouse using SSIS packages
- Integrating data from heterogeneous sources such as databases, flat files, XML, and APIs into a unified format for analysis and reporting purposes
- Implementing robust error handling mechanisms within SSIS packages to capture, log, and handle errors gracefully during data extraction, transformation, and loading processes
- Documenting technical designs, procedures, and best practices for data engineering processes and solutions.
Senior SQLBI Developer
Techno brain
01.2017 - 01.2018
- As Lead BI Consultant involved in handling Projects for Tax Regulation Processing System -Kenya
- Projects worked: TRIPS-Kenya-Ghana Tools Technologies: SSIS, Kingsway soft, Oracle,SQL,SSAS,SSRS Role and Responsibilities Contribute in data migration from Oracle to SQL DW using SSIS Created Views Tables Stored Procedures Migrated Sales force data to CRM Database using Kingsway soft Extracted Flat files data Transform and Load into SQL dw Normalized and designed DB in 3NF Collaborate with database developers, data architects, business analysts, and end-users to gather requirements, validate data mappings, and ensure alignment with business needs
- Provide technical support, troubleshooting, and resolution for SSIS-related issues, including package failures, data discrepancies, and performance degradation.
Team Leader
CAPGEMINI
01.2012 - 01.2017
- As Team Lead involved in handling ETL process for Banking Domain
- Projects worked: Vendor Management, Royal Bank of Canada and Rockwell Automation Tools Technologies: SSIS, SSRS Role and Responsibilities Design end-to-end ETL solutions based on business requirements, data sources, and target systems
- Extract data from various source systems, including databases, flat files, APIs, and web services, using SSIS data flow components such as OLE DB Source, Flat File Source, and Web Service Source
- Transform and cleanse data using SSIS data transformation tasks such as Derived Column, Lookup, Conditional Split, and Merge Join
- Implement data quality checks, data validation rules, and error handling mechanisms to ensure data integrity.
ETL Developer
CGI
01.2009 - 01.2012
- As ETL developer in handling Projects in MSBI Tools for Banking and Engineering Manufacturing
- Projects worked: CIGNA and Dutch bank Tools Technologies: SSIS,SSRS,SSAS,SQL,AS400,COBOL,MAINFRAMES Role and Responsibilities Contributed in Data Transformation using SSIS from Flat files to SQL Staging Contributed in creating SQL Transformation to Load data SQL staging to SQl Prestaging Contributed in creating SQL jobs for triggering Views to load data to Staging Contributed in creating Derived columns based on business requirement Contributed in creating Split condition to split data based on criteria Contributed in creating MERGE transformation to combine two parallel table to Datawarehouse Contributed in data migration from IBMdb2 and IMS400 to CIGNA
.Net Developer
ETG
01.2009 - 01.2012
- As Net developer in handling Projects in B2B Applications build websites ecommerce and windows applications using C#.Net ASP.NET and Ado.NET,SQL
- Role and Responsibilities N/A
Education
Master’s In computer applications -
University Madras
Bachelor’s in computers science - undefined
University Nagarjuna
Skills
Azure Data Engineering
undefinedAccomplishments
Topgear award from Wipro Technologies
Patback award from Yash Technologies
Certification
Microsoft Certified: Azure Data Engineer Associate
Interests
Travelling
Timeline
Microsoft Certified: Azure Data Engineer Associate
04-2024
Designing and Implementing Enterprise-Scale Analytics Solutions Using Microsoft Azure and Microsoft Power BI
04-2024
Senior Data Engineer
OSB INDA PVT LTD
01.2023 - Current
Senior Azure Data Engineer
Wipro Technologies
01.2020 - 01.2023
Lead Data Engineer
Yash Technologies
01.2018 - 01.2020
Senior SQL BI
Prolific
01.2018 - 01.2019
Senior SQLBI Developer
Techno brain
01.2017 - 01.2018
Team Leader
CAPGEMINI
01.2012 - 01.2017
ETL Developer
CGI
01.2009 - 01.2012
.Net Developer
ETG
01.2009 - 01.2012
Master’s In computer applications -
University Madras
Bachelor’s in computers science - undefined
University Nagarjuna
Similar Profiles
Tulasi RachamallaTulasi Rachamalla
Senior Customer Success Specialist at Oracle Inda Pvt LimitedSenior Customer Success Specialist at Oracle Inda Pvt Limited
ANUSH SRINIVASANANUSH SRINIVASAN
Process Lead- Financial Reporting at Pride Global Services Inda Pvt LtdProcess Lead- Financial Reporting at Pride Global Services Inda Pvt Ltd
MUTHUVAIRAVAN NMUTHUVAIRAVAN N
Automation Maintenance Engineer at MICHELIN INDA PVT LTDAutomation Maintenance Engineer at MICHELIN INDA PVT LTD
Jaspreet Singh DhadialJaspreet Singh Dhadial
SAP Basis Consultant at Deloitte US-India OfficesSAP Basis Consultant at Deloitte US-India Offices
Marshall LepchaMarshall Lepcha
Shop Supervisor at Costa CruisesShop Supervisor at Costa Cruises