Summary
Overview
Work History
Education
Skills
Certification
Details
Personal Information
Languages
Timeline
Generic
Divya K

Divya K

Bengaluru

Summary

An accomplished data engineering professional with extensive expertise in designing and executing complex big data pipelines and workflows across diverse cloud platforms spanning over 7 years of experience.

Overview

1
1
Certification

Work History

Programmer Analyst

Cognizant Tenchnology Solutions
Chennai
  • Z Ytili-ed Spark Scala to develop ETL code for seamless data transfer from Hive to RedshiftJ ensuring efqcient data loading processes
  • Z Demonstrated expertise in formulating and executing adWhoc Oueries within Hive and AjS RedshiftJ contributing to the identiqcation and resolution of dataWrelated anomalies.

Senior Software Engineer

Mindtree Limited
Chennai
  • Z Proqciently designed and implemented Spark applications employing PySpark and SparkSQL
  • Successfully extracted and transformed data to reveal valuable insights into customer usage patterns
  • Z Skillfully established dedicated pipelinesJ orchestrated executionJ and scheduling utili-ing A-ure Data
  • ActoryJ Logic AppsJ and Databrick (obs within the A-ure platform and Pinot
  • Z )Developed userWfriendly interfaces for business stakeholders using the Streamlit library in Python.

Data Engineering Specialist

Accenture
Bengaluru
  • Z Contributed signiqcantly by improving and transitioning hiveWcompatible PySpark code to versions compatible with Google BigQueryJ ensuring a smooth migration process
  • Z Successfully refactored intricate HQLs CHive Query LanguageD into BigQueryJ leveraging PySpark to achieve enhanced performance and efqciency
  • Z )Proqciently crafted intricate Air,ow Directed Acyclic Graphs CDAGsD to execute PySpark codeJ effectively automating and managing complex data processing tasks z Engineered Spark pipelines within A-ure Databricks to facilitate data ingestion into Delta format and seamless export to Redshift.

Education

B.Tech in Computer Science and Engineering -

College of Engineering Thalassery, Thalassery
04.2016

Skills

  • Apache Spark
  • SQL
  • Databricks
  • GCP
  • Python
  • PySpark

Certification

  • Databricks Certified Associate Developer for Apache Spark 3.0
  • Google Cloud Certified - Professional Data Engineer

Details

Bengaluru, India

Personal Information

Title: DATA ENGINEER

Languages

  • English
  • Malayalam
  • Hindi

Timeline

Programmer Analyst

Cognizant Tenchnology Solutions

Senior Software Engineer

Mindtree Limited

Data Engineering Specialist

Accenture

B.Tech in Computer Science and Engineering -

College of Engineering Thalassery, Thalassery

Similar Profiles

CREATE PROFILE
Divya K