Summary
Overview
Work History
Education
Skills
Impact
Timeline
Generic

Rajeswari Lakshminarayanan

Chennai

Summary

I am an accomplished Data Engineer with three years of expertise in designing robust pipelines using Python, SQL, and Apache Spark. I have an amazing track record in optimizing ETL processes resulting in a 50% reduction in processing time and introduced performance optimization strategies, resulting in a 25% reduction in cloud infrastructure costs for data processing. I have always been a collaborative team player thriving in dynamic environments. I am eager to bring innovation and efficiency to a challenging Data Engineer role.

Overview

3
3
years of professional experience

Work History

Data Engineer

Condé Nast
Chennai
06.2021 - Current

Project - Obsidian (Jun 2021 - Till Present)

Cookie-less solution for providing contextual targeted advertisements for users visiting Condé Nast and its affiliated web pages.

  • Collaborated with ad targeting team to design and implement advanced cookie-less solutions, optimizing for precision and scalability.
  • Developed PySpark ETL pipelines for seamless integration of diverse data sources to collect related articles for key segments created in the Obsidian UI.
  • Designed the workflow for SpireLAL, an internal feature.
  • Orchestrated efficient pipelines, dags, and integration for enhanced related article gathering for SpireLAL segments.
  • Engineered a Pyspark pipeline for European market integration, optimizing data collection, grouping, and context extraction.

Project - Recommendations Pipeline Development (Sep 2023 - Till Present)

  • Developed robust ML data pipeline, leveraging advanced text embeddings for enhanced recommendation model inputs.
  • Built a dedicated Recommendations Team pipeline, designed for HAL data ingestion from the ML datasource, boosting algorithm efficiency and relevance.

Data Engineer - Intern

Condé Nast
Chennai
02.2021 - 05.2021

Project - A Slack Extension to Obsidian

  • Built a Slack bot to query Obsidian database and integrate results into Slack channels.
  • Tech Stack: REST API, Elasticsearch, MySQL

Education

B.Tech - Information Technology

SASTRA University
Thanjavur, India
10-2021

Skills

  • Python
  • Java
  • PySpark
  • Databricks
  • Airflow (Astronomer)
  • MySQL
  • Elasticsearch
  • AWS S3

Impact

  • Streamlined Workflow Implementation: Revamped pipeline architecture through streamlined workflow categorization, enhancing efficiency.
  • Pipeline Time Efficiency Improvement: Achieved a remarkable 50% enhancement in pipeline time efficiency for faster data processing.
  • Elasticsearch Cost Optimization: Led an outstanding cost optimization for Elasticsearch, reducing expenses by 25%.
  • Obsidian Reach Expansion: Significantly expanded Obsidian's reach from 24% to 65% by identifying and resolving a critical bug, improving system reliability.

Timeline

Data Engineer

Condé Nast
06.2021 - Current

Data Engineer - Intern

Condé Nast
02.2021 - 05.2021

B.Tech - Information Technology

SASTRA University

Similar Profiles

CREATE PROFILE
Rajeswari Lakshminarayanan