Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Samreed Shaik

Chennai

Summary

Insightful Senior Data Engineer known for high productivity and efficiency in task completion. Possess specialized skills in data modeling, ETL development, and cloud computing solutions. Excel in problem-solving, teamwork, and communication, ensuring successful project outcomes and effective collaboration with cross-functional teams.

Overview

14
14
years of professional experience
1
1
Certification

Work History

Senior Data Engineer

Paypal India Private Limited
Chennai
04.2025 - Current
  • Migrated on-prem legacy pipelines to GCP (BigQuery, Dataflow, Pub/Sub), reducing processing time by 40%.
  • Built ETL pipelines on AWS (S3, Redshift) for cross-cloud data integration and analytics.
  • Optimized Spark jobs in Databricks to improve job execution by 30%, reducing cluster costs.
  • Designed and implemented data lakehouse architecture on Databricks, enabling seamless batch and streaming ingestion of multi-TB datasets.
  • Engineered scalable infrastructure tailored to complex financial use-cases (Accounting, Regulatory Reporting and FP&A)
  • Designed PayPal's payment flow model in BigQuery for regulatory compliance and Analytics usecase
  • Led the reconciliation process between SAP ECC and Hadoop-based SOR for several key financial metrics, including Revenue, Customer Liability and Total Payment volume (TPV)
  • Developed and implemented the ETL pipeline for PayPal's M & A data from Hive and BigQuery into the SAP HANA Finance Product Subledger to support daily financial close operations.
  • Developed a scalable pipeline transferring data from Oracle to Hive and BigQuery using Dataproc and PySpark.
  • Collaborated with cross-functional teams to identify and translate business requirements into technical specifications.
  • Led a team of 5 data engineers, driving agile delivery and enforcing CI/CD best practices.

Data Engineer

PayPal India
Chennai
01.2019 - 03.2025
  • Analyzed user requirements, designed and developed ETL processes to load enterprise data into the Data Warehouse.
  • Migration of legacy SQL from Teradata to Hive using spark, Sqoop & TPT
  • Developed various Spark jobs using Scala and Spark SQL with proper allocation of executor memory, cores and Driver memory.
  • Developed a robust ETL pipeline from external sources like AWS S3, SAP Hana into Hadoop
  • Analyzed the data and created proper partitioned/Bucketed hive tables for efficient data processing.

Senior Associate

Cognizant
Chennai
04.2017 - 12.2018
  • Developed various HQL jobs to load data from various feeds to Hive tables.
  • Monitored the performance of cluster and nodes in Ambari.
  • Configuration of file transfer jobs using SFTP/SCP in unix servers
  • Created shell scripts to archive data into HDFS

Software Engineer

Mphasis
Chennai
09.2011 - 04.2017
  • Involved in design, development and customizations of modules, testing and support of Insurance applications.
  • Created database packages, stored procedures, functions and triggers using Oracle PL/SQL.
  • Interacted with clients to gather requirements for enhancements.
  • Analyzed requirements and provided effort estimation.
  • Responsible for writing design documents, user documentations and test plans.

Education

Master of Computer Applications -

RVRJC College of Engineering
Guntur, Andhra Pradesh, India
06-2011

Skills

  • ETL Development
  • BigQuery
  • Dataproc
  • Python
  • Shell Script
  • Hadoop
  • Spark
  • Airflow/UC4/Control-M
  • CI/CD
  • AWS (S3, Redshift)
  • Data lakehouse architecture
  • Databrics
  • Snowflake
  • Cloud Migration
  • Technical Leadership
  • Effective communication

Certification

  • Databrics accredited Generative AI fundamentals

Timeline

Senior Data Engineer

Paypal India Private Limited
04.2025 - Current

Data Engineer

PayPal India
01.2019 - 03.2025

Senior Associate

Cognizant
04.2017 - 12.2018

Software Engineer

Mphasis
09.2011 - 04.2017

Master of Computer Applications -

RVRJC College of Engineering

Similar Profiles

CREATE PROFILE
Samreed Shaik