Summary
Overview
Work History
Education
Skills
Websites
Awards
Hobbies and Interests
Appreciations
Activities
Timeline
Generic

C Y Prajwal

Big Data Engineer
Bengaluru

Summary

Big Data Engineer with 3+ years of experience in designing and implementing robust data pipelines, ETL workflows, and analytics solutions. Proficient in Hadoop, Spark (versions 2 & 3), Hive, Impala, Airflow and CDH/CDP with strong expertise in performance optimization. Demonstrated ability to manage production workflows, resolve complex issues, and deliver scalable, high-quality solutions within Agile environments.

Overview

3
3
years of professional experience

Work History

Software Developer

IQVIA
03.2024 - Current

Project: MIDAS and OTCIMS Replatforming, CHTR

  • Migrated 8 Projects from CDH Clusters to Cloudera CDP Clusters and optimized workflows using Spark and Airflow.
  • Migrated 8 Jenkin projects to gitlab CI/CD.
  • Implemented performance tuning for Impala queries and automated alerts using Airflow DAGs.
  • Handled L3 production issues and peer-reviewed code changes for critical components.
  • Facilitated Scrum ceremonies and effectively managed task allocation across team members to ensure timely delivery of project milestones during CPD and gitlab CI/CD migration.

Associate Software Developer

IQVIA
03.2023 - 02.2024

Projects: MIDAS-SBD & QDBDF

  • Managed end-to-end production data refresh processes and implemented complex business logic for healthcare analytics, ensuring accuracy and compliance with domain standards.
  • Automated DAP alerts and Impala refresh processes using Airflow.
  • Developed and optimized Spark jobs for large-scale data processing.
  • Collaborated with business teams to address data queries, and ensure data quality.

Intern

IQVIA
09.2022 - 02.2023
  • Learned Hadoop ecosystem tools and contributed to production workflows for MIDAS-SBD.
  • Assisted in bug detection and QA checks for data refresh processes.

Education

Bachelor of Technology -

Dayananda Sagar University
Bangalore
06-2022

Intermediate (PUC) -

Smt. Vidya P. Hanchinmani PU Science College
Dharwad, Karnataka
04-2018

SSLC -

K E Board’s English Medium School
Dharwad, Karnataka
04-2016

Skills

  • Spark
  • Scala
  • Pyspark
  • Hive
  • Impala
  • SQL
  • CDH
  • CDP
  • Azure
  • Jenkins
  • Azure Devops
  • GitHub
  • GitLab
  • Airflow
  • GitHub Co-Pilot
  • Git-Lab Duo
  • Cursor AI IDE
  • CI/CD integration

Awards

Ovation Award, 2024

Hobbies and Interests

  • Trekking
  • Sports enthusiastic

Appreciations

  • SBD Project Appreciation
  • CH Attributes Release
  • CH Delivery
  • QDBDF Project Appreciation

Activities

Apache Spark 3 & Big Data Essentials in Scala,

Hive for processing Big Data,

Git: A step-by-step guide to version control,

IQVIA Internal Football Tournament,

Best striker - 2025, best goalkeeper - 2024

Timeline

Software Developer

IQVIA
03.2024 - Current

Associate Software Developer

IQVIA
03.2023 - 02.2024

Intern

IQVIA
09.2022 - 02.2023

Bachelor of Technology -

Dayananda Sagar University

Intermediate (PUC) -

Smt. Vidya P. Hanchinmani PU Science College

SSLC -

K E Board’s English Medium School
C Y PrajwalBig Data Engineer