Summary
Overview
Work History
Education
Skills
Timeline
Generic

Sai Prannoy Manas

Senior Data Engineer
Hyderabad

Summary

Led a team of 18 data engineers in optimizing cloud-based solutions using Microsoft Fabric and Azure Data Factory, driving a 100-fold increase in report refresh speed. Skilled in communication and teamwork, with a strong focus on ensuring data integrity and regulatory compliance through rigorous governance practices.

Overview

7
7
years of professional experience
3
3
Languages

Work History

Technical Lead

Quadrant Technologies
05.2024 - Current
  • Led a team of 18 in the development and maintenance of cloud-based data solutions.
  • Architected and optimized data pipelines in Microsoft Fabric, enhancing performance by fifty percent.
  • Reduced report refresh time from forty minutes to two minutes, achieving a performance improvement of 100X.
  • Worked on data migration from on-prem source to Fabric for new customer onboarding.
  • Worked on testing Virtualization – Delta to Iceberg conversion – feature in Fabric by creating shortcuts from Snowflake iceberg tables in a fabric lakehouse.
  • Developed and tested shortcuts for Amazon S3 and external ADLS in Fabric, streamlining data access.
  • Utilized Fabric notebooks and SQL endpoints for efficient data ingestion, transformation, and querying.
  • Strengthened security and governance policies by using RBAC roles in OneLake to ensure data integrity and compliance.
  • Collaborated with cross-functional teams and delivered weekly reviews and technical presentations to Microsoft clients, receiving positive feedback on clarity.

Data Engineer

Kingston Info Solutions
01.2021 - 05.2024
  • Developed end-to-end ETL workflows leveraging Azure Synapse Analytics, ADLS Gen2, Azure Data Factory, and Databricks.
  • Implemented a metadata-driven ingestion model with Databricks as ingestion layer and data factory as orchestrator
  • Optimized transformation logics in Mapping Data Flows and implemented data cleansing and modelling techniques.
  • Automated monitoring & alerting for data pipelines using Log Analytics & Logic Apps, minimizing downtime.
  • Built CI/CD pipelines in Azure DevOps to improve release efficiency across multiple environments.

Associate Data Engineer

Kingston Info Solutions
01.2019 - 01.2021
  • Role: Transitioned from a Junior Systems Engineer to a Cloud Data Engineer.
  • Designed and implemented ETL pipelines using Azure Data Factory, ADLS Gen2, and Azure SQL Databases.
  • Conducted unit testing & documentation for data ingestion pipelines, ensuring data accuracy.
  • Resolved high-priority production issues, as soon as they were found out.
  • Led cross-functional collaborations for data source integration and analytics enablement.

Education

Bachelor of Technology - Electrical Engineering

K.L. University
Vijayawada, India
04.2001 -

Skills

Microsoft Fabric

Azure Databricks

Azure Synapse Analytics

Azure Data Lake Gen2

Azure DevOps (CI/CD)

Delta Lake

SQL

PySpark

Spark

Kusto Query Language

Data Governance, Security & Compliance

Logic Apps

Timeline

Technical Lead

Quadrant Technologies
05.2024 - Current

Data Engineer

Kingston Info Solutions
01.2021 - 05.2024

Associate Data Engineer

Kingston Info Solutions
01.2019 - 01.2021

Bachelor of Technology - Electrical Engineering

K.L. University
04.2001 -

Similar Profiles

CREATE PROFILE
Sai Prannoy ManasSenior Data Engineer