Suhas Lavadia

Data Engineer | Analyst
DBS Bank
September 2023 – Present

• Optimized and deployed PySpark workflows into production environments, guaranteeing efficient data processing.
• Enhanced data reliability and accuracy by implementing robust validation mechanisms and advanced monitoring tools.
• Supported the final phase of a large-scale migration project by fine-tuning PySpark scripts for optimal performance.
• Collaborated with cross-functional teams to maintain and enhance data engineering pipelines.
• Managed a dedicated team to oversee daily operations and deliver project milestones effectively.
• Actively participated in the Change Request (CR) process, providing technical insights and ensuring smooth implementation.

Senior Officer
DBS Bank
July 2022 – September 2023

• Initiated and led a migration project transitioning SAS scripts to PySpark scripts, resulting in enhanced scalability and performance.
• Converted and validated SAS scripts into PySpark, ensuring compatibility and adherence to organizational standards.
• Automated and streamlined data pipelines, improving operational efficiency and reducing manual intervention.
• Provided technical support and conducted knowledge transfer sessions to facilitate the adoption of PySpark within the team.