Summary
Work History
Education
Skills
Accomplishments
Timeline
Interests
BusinessAnalyst

Suryapavan Chandra

Data Engineer | Data Platform | Data Governance | Databricks | PySpark | SQL
Mumbai

Summary

Data Engineer with 3+ years of experience designing and optimizing scalable data platforms using Databricks, PySpark, SQL, Delta Lake, and Unity Catalog. Proven expertise in building ETL/ELT pipelines, Medallion Architecture, metadata management, data cataloging, and enterprise data governance solutions. Experienced in implementing Data Catalog and Data Marketplace platforms using RightData DataTrust and Data Market, enabling enterprise-wide data discovery, lineage, compliance, and governed data product delivery. Successfully integrated 32+ enterprise applications and delivered analytics-ready data products while ensuring data quality, security, and regulatory compliance.

Work History

Data Engineer

Resurgent Enterprise Solutions (Client: NABARD)
Mumbai
08.2025 - Current
  • Served as one of the core engineers in building NABARD's enterprise Data Governance Platform from the ground up, driving architecture, onboarding strategy, and platform adoption.
  • Led a team of 3 Data Engineers and collaborated with client stakeholders to deliver enterprise-scale data engineering and governance initiatives.
  • Designed and developed scalable data ingestion, metadata processing, and governance workflows using Databricks, PySpark, Spark SQL, Delta Lake, and Unity Catalog for NABARD's enterprise data platform.
  • Integrated 32+ enterprise applications across MySQL, PostgreSQL, SQL Server, Oracle, and AWS S3 into a centralized Databricks Lakehouse, enabling unified data visibility and governance.
  • Executed large-scale metadata onboarding and cataloging processes, generating 100,000+ datasets and cataloging 1M+ columns through automated Databricks pipelines.
  • Built and optimized ETL/ELT pipelines using PySpark and Spark SQL, improving metadata processing performance and scalability across enterprise systems.
  • Designed and published 200+ governed data products, delivering trusted, analytics-ready datasets for business users and reporting platforms.
  • Implemented PII discovery, classification, and masking for 200K+ sensitive data fields, strengthening enterprise data security, privacy, and compliance.
  • Developed advanced Spark SQL and analytical queries for data validation, profiling, reconciliation, and metadata analysis, ensuring high data quality standards.
  • Leveraged LLM-powered classification and governance automation to accelerate sensitive data identification and business glossary enrichment.
  • Owned the end-to-end lifecycle of governance assets, including dataset onboarding, metadata enrichment, lineage validation, business glossary mapping, and governed data product delivery.

Software Engineer

UniqueHire Consulting LLP
Bengaluru
06.2023 - 08.2025
  • Developed and maintained ETL pipelines using Python, SQL, and Databricks for HRMS and Healthcare applications.
  • Processed and managed 4,000+ datasets, enabling efficient analytics, reporting, and business intelligence workflows.
  • Performed data profiling, cleansing, standardization, and quality checks to ensure reliable and accurate data processing.
  • Built and optimized SQL queries and backend integration services to support cross-application data exchange.
  • Developed REST APIs and integration services for seamless data movement across multiple applications.
  • Stored and managed transformed datasets in MySQL and PostgreSQL databases supporting reporting and operational platforms.
  • Monitored and maintained Linux-based production ETL environments, troubleshooting issues and improving system performance.
  • Resolved production incidents and performance bottlenecks, ensuring high availability and reliability of critical applications.
  • Automated deployment and release activities, contributing to streamlined delivery and operational efficiency.
  • Executed client deployment activities for FauxIQ Technologies, ensuring successful implementation and production readiness.

Client Deployment: FauxIQ Technologies (Apr 2025 – Aug 2025)

Education

Bachelor of Technology (B.Tech) - Information Technology

Sree Vidyanikethan Engineering College
Tirupati, India
07.2020 - 05.2023

Diploma - Computer Engineering

Sri Chundi Ranganayakulu Engineering College
Guntur, India
08.2017 - 06.2020

Master of Technology - Computer Science And Engineering

Jawaharlal Nehru Technological University
Kakinada

Skills

SQL

Python

Data Processing

Data Governance

Data Catalog

Metadata Management

ETL/ELT Pipelines

SQL and databases

Delta Lake

Data Quality

Data Warehousing

AWS S3, MySQL, PostgreSQL, Oracle ,SQL Server

Linux

Accomplishments

  • Enterprise Data Discovery at Scale: Executed large-scale metadata cataloging processes, generating 100,000+ datasets and significantly improving enterprise-wide data discoverability.
  • Enterprise Application Integration: Integrated 32+ enterprise applications across MySQL, PostgreSQL, SQL Server, Oracle, and AWS S3 into a centralized governance platform.
  • Large-Scale Metadata Governance: Built and maintained a metadata catalog covering 1M+ columns, enabling scalable data discovery, lineage, and governance.
  • Data Product Enablement: Designed and published 200+ governed data products, delivering trusted and standardized datasets for analytics and reporting.
  • Sensitive Data Protection: Identified, classified, and masked 200K+ PII fields, strengthening enterprise data privacy, security, and regulatory compliance.
  • Platform Foundation Engineer: Served as a core engineer in building NABARD's enterprise Data Governance Platform from the ground up, driving onboarding, governance, and data marketplace adoption.
  • Leadership & Delivery: Led a team of 3 Data Engineers to successfully deliver enterprise-scale data engineering and governance initiatives.

Timeline

Data Engineer

Resurgent Enterprise Solutions (Client: NABARD)
08.2025 - Current

Software Engineer

UniqueHire Consulting LLP
06.2023 - 08.2025

Bachelor of Technology (B.Tech) - Information Technology

Sree Vidyanikethan Engineering College
07.2020 - 05.2023

Diploma - Computer Engineering

Sri Chundi Ranganayakulu Engineering College
08.2017 - 06.2020

Master of Technology - Computer Science And Engineering

Jawaharlal Nehru Technological University

Interests

Data Engineering

Big Data Technologies

Artificial Intelligence

Data Governance

Cloud Data Platforms

Analytics

Suryapavan ChandraData Engineer | Data Platform | Data Governance | Databricks | PySpark | SQL