Punithkumar L

Data Engineering & Real-Time Ingestion:

• Pipeline Development: Designed and deployed real-time ingestion pipelines using Kafka, Spark, Airflow, and Snowpipe, improving data freshness and availability.
• Streaming Integration: Integrated Kafka with Snowflake for event-driven ingestion, enabling real-time analytics.

Database Design & Development:

• Built and maintained a data model in Snowflake for reporting needs.
• Engineered a high-efficiency data model that boosted query performance by 50%.
• Orchestrated a data pipeline within Snowflake using tasks and DAGs for observability.

ETL & Data Transformation:

• Developed scalable ETL pipelines using Kafka and PySpark to ingest and transform real-time streaming data, reducing processing latency by 40%.
• Orchestrated complex data workflows with Apache Airflow, integrating Snowflake for high-performance analytics, and ensuring end-to-end data reliability across batch and streaming jobs.
• Optimized transformation logic in PySpark and Snowflake, enabling schema evolution and dynamic partitioning, which improved query performance and reduced compute costs by 30%.
• Configured tasks in Snowflake to automate and schedule data pipeline execution.

Performance Tuning & Optimization:

• Tuned complex SQL queries using Query Profiler to improve performance and reduce costs using Snowflake clustering, search optimization, and one big table concepts.
• Reduced execution time of heavy workloads by optimizing code logic and query plans.

Collaboration and Communication:

• Worked closely with DevOps, data analysts, and business teams to align technical solutions with operational needs.
• Designed and maintained detailed technical documentation for the data model and architecture.

• Snowflake and Oracle Development: Engineered stored procedures, functions, and triggers to execute business-critical logic within the investment platform.
• Code Optimization: Refactored existing PL/SQL modules to improve performance and reduce system latency.
• Performance Tuning: Enhanced SQL performance using Explain Plan to analyze and optimize complex query execution.
• Project Compliance: Ensured adherence to coding standards and documentation protocols throughout the development lifecycle.

• PL/SQL Development and Optimization: Developed and enhanced stored procedures, functions and complex PL/SQL code to support pharmaceutical data operations, migration, and improve system efficiency.
• Advanced Oracle Programming: Utilized ref cursors, collections, and bulk operations for high-volume data handling in regulated environments.
• Performance Tuning: Improved SQL performance using Explain Plan and query optimization techniques to minimize latency.

• PL/SQL Development and Optimization: Developed and enhanced stored procedures, functions, triggers, and complex PL/SQL code to support pharmaceutical data operations, and improve system efficiency.
• Database Design & Management: Modeled and implemented relational database objects (tables, indexes, sequences, constraints) to ensure data integrity and performance.

• PL/SQL Development & Optimization: Developed and enhanced stored procedures, functions, triggers, and complex PL/SQL code to support pharmaceutical data operations and improve system efficiency.
• Database Design & Management: Modelled and implemented relational database objects (tables, indexes, sequences, constraints) to ensure data integrity and performance.