Sinchana M R
Bengaluru
Summary
Experienced with designing and optimizing data pipelines to ensure seamless data flow. Utilizes advanced SQL and Python skills to create and maintain robust data architectures. Track record of implementing scalable solutions that enhance data integrity and support informed decision-making.
Overview
1
1
Certification
Work History
Data Engineer
Target
08.2024 - 01.2025
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability and optimized ETL pipelines using Spark SQL to efficiently process large-scale data, significantly reducing processing time and enhancing overall efficiency.
- Developed and maintained the Channel pipeline using Scala, performing data processing, portal publishing and to validate and reconcile data with the source team, and managing file transfer, resulting in 25% reduction in processing time.
- Implemented batch data processing using PySpark, streamlining workflows and improving data handling efficiency
- Used SQL queries to load and execute approximately 30GB of data into data warehouses every 30days, maintaining up-to-date data availability with 95% accuracy rate
- Worked with Hive to query and manage terabytes of data, using HiveQL for data analysis in the Hadoop ecosystem, resulting in a 20% increase in data insights and 15% reduction in data retrieval time
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Collaborated with cross-functional teams for seamless data integration sources into the company's data ecosystem.
Education
BTech - Electrical and Electronics
University Visvesvaraya College of Engineering
Bengaluru, India07-2024
Skills
- Python
- SQL
- Apache Spark
- Apache Hadoop
- Linux
- Hive
- Scala
- ETL development
- Data warehousing
- Data migration
- Spark framework
- Data analysis
PROJECT
- Email Automation
Developed the Email Automation project in Python, utilizing libraries such as json, smtplib, and JCEKS(Java Cryptography Extension KeyStore) for password encryption, ensuring the secure handling of sensitive data within the email automation system, with keys stored securely, resulting in a 30% reduction in data breaches.
- Library Management
Implemented user authentication, book addition/removal, issuance tracking, and inventory view features, showcasing expertise in Python, Tkinter, and GUI development.
Certification
- Data Engineer Apprenticeship, Target
- Introduction to Data Engineer, Udemy
- Introduction to SQL, Simplilearn
Timeline
Data Engineer
Target
08.2024 - 01.2025
- Data Engineer Apprenticeship, Target
- Introduction to Data Engineer, Udemy
- Introduction to SQL, Simplilearn
BTech - Electrical and Electronics
University Visvesvaraya College of Engineering
Similar Profiles
Mayleen EdwardsMayleen Edwards
Cashier at TargetCashier at Target
Javier Palacios Jr.Javier Palacios Jr.
General Merchandise Expert at TargetGeneral Merchandise Expert at Target
Andrew BastidaAndrew Bastida
Fulfillment Associate at TargetFulfillment Associate at Target