Summary
Overview
Work History
Education
Skills
Websites
Timeline
Generic
Vaishnavi S

Vaishnavi S

Bangalore

Summary

Experienced Data Engineer with a proven track record in designing, implementing, and optimizing data pipelines. Proficient in ETL processes and technologies, including Spark, MapReduce, and Azure services. Skilled in programming languages such as Python and SQL, with a focus on building scalable and efficient data solutions. Strong collaborator with cross-functional teams, adept at problem-solving and delivering high-quality results

Overview

3
3
years of professional experience

Work History

Associate Data Engineer

Landmark Group
09.2021 - Current
  • Data Engineer with close to 3 years of experience for a retail giant with operations in Gulf and India. Hands on experience in ADB, ADF, Hive, Azure, SAS, Pyspark, Python and SQL.
  • Data Warehousing experience in Hive and Azure Data Lake.
  • Managed lifecycle elements of ETL development, from robust testing to final deployment.
  • Closely monitored data warehouse functionality and performance, proactively responding to issues.
  • Collaborated with product team, in order to build an in house product: To launch Campaigns.
  • Mentored team of four people for complete hands on of CVM responsibilities of SAS ETL's.

SAS :

  • CVM - Data Handling/ In charge of day to day operations and data deliverables for CVM/Loyalty Program across gulf dealing with offline and online data across different sources.
  • Developed, maintained and automated several ETL's to cover complex business logic.

Azure :

  • Data migration from On-prem to Azure ADLS Gen2.
  • Migration and automation of ETLs from SAS to Azure (ADF, ADB).
  • Segmented customers with analytics focused on revamping marketing campaigns and used insights to help businesses overcome challenges.
  • Documentation of pipelines and best practices on platform

POC's :

  • POC on ASA -to check feasibility for DW and as a platform.
  • POC on Mo-Engage as a new data source for campaign's- data integration, parsing and data warehousing.
  • POC on Epsilon - new source for loyalty- transaction data. Data QC, Consistency, Integration Testing done.

Education

Bachelor of Engineering - Information Science and Engineering

RNSIT
Bangalore
2021

Skills

  • Languages : Python, PySpark, SQL, Unix, Java, C, SAS
  • Platform: Azure, ADF, ABD, Hive, Hadoop
  • Manual test case preparation
  • Automation knowledge
  • Cross-platform testing
  • ETL development
  • Data Pipeline Design
  • Data Warehousing
  • Data Migration
  • Data Modeling
  • Spark Framework
  • Big Data Analytics

Timeline

Associate Data Engineer

Landmark Group
09.2021 - Current

Bachelor of Engineering - Information Science and Engineering

RNSIT
Vaishnavi S