Gnanasekar Perumal

Over 14+ years of IT experience this includes:

Experienced Data Engineer with over 6+ years of expertise in designing and implementing Lake House architectures utilizing Data bricks and Azure Data Flow. Proficient in developing efficient data pipelines, optimizing data workflows, and leveraging big data technologies for real-time analytics. Strong collaborator adept at working with cross-functional teams to drive data-driven solutions. Implemented data governance and quality checks, ensuring compliance and reliability of data across the Lake house environment.

Microsoft Certified: Azure Data Engineer Associate (DP-203)

CURRENT PROJECT

Travelodge (TAP)
Client: Travelodge Hotels, UK
Role: Senior Azure Data Engineer
Technologies: Azure Data Factory, Data flow Azure SQL Database, Synapse and Data bricks

Project Description:
Developed solutions to optimize data pipelines and ensure compliance within the hotel industry.

Key Responsibilities:

· Designed and implemented a Lakehouse architecture leveraging Databricks and Azure Data Flow, integrating data lakes and warehouses for enhanced data accessibility and performance.

· Developed data ingestion workflows using Azure Data Flow to automate data pipelines, ensuring seamless integration of various data sources into Databricks.

· Collaborated with data scientists and business analysts to create real-time dashboards and reports, utilizing Databricks for advanced data processing and analytics.

· Implemented data governance and quality checks, ensuring compliance and reliability of data across the Lakehouse environment.

· Implement and manage data lakes and data warehouses on Azure, ensuring optimal performance and scalability.

PAST PROJECTS

CRRI (Cost Reduction Road Map)
Client: International Paper
Role: Technology Lead - Azure Data Engineer

• Developed data solutions to streamline cost reduction initiatives.

Key Responsibilities:

· Understand data requirements and deliver solutions that meet business needs.

· Design and develop data pipelines using Azure Data Factory, Azure Synapse Analytics, and other Azure data services.

· Assisted in building ETL processes within a Lakehouse environment, optimizing data flow from legacy systems to Databricks using Azure Data Flow.

· Conducted performance tuning of Spark jobs in Databricks, improving processing speed.

· Supported the migration of on-premises data to a cloud-based Lakehouse architecture, ensuring data integrity and consistency throughout the process.

· Monitor and troubleshoot data pipelines and infrastructure to address performance issues and outages.

IP RADS (International Paper - Rapid Applications Development Systems)
Role: Technology Lead

• Coordinated development and testing phases, ensuring timely project completion.

Disability Income
Client: Northwestern Mutual

• Managed development phases for a disability income insurance product

Budget Management Systems & IT Integrated Asset Systems (ITTAS)
Client: Samsung India Electronics Pvt Ltd

• Developed applications for budget analysis and asset management.

• Pan Number: BAJPG9430N
• Passport Number: Z4046380
• Date of Birth: 03/25/1986
• Nationality: Indian
• Marital Status: Married