Samreed Shaik
Chennai
Summary
Insightful Senior Data Engineer known for high productivity and efficiency in task completion. Possess specialized skills in data modeling, ETL development, and cloud computing solutions. Excel in problem-solving, teamwork, and communication, ensuring successful project outcomes and effective collaboration with cross-functional teams.
Overview
14
14
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Paypal India Private Limited
Chennai
04.2025 - Current
- Migrated on-prem legacy pipelines to GCP (BigQuery, Dataflow, Pub/Sub), reducing processing time by 40%.
- Built ETL pipelines on AWS (S3, Redshift) for cross-cloud data integration and analytics.
- Optimized Spark jobs in Databricks to improve job execution by 30%, reducing cluster costs.
- Designed and implemented data lakehouse architecture on Databricks, enabling seamless batch and streaming ingestion of multi-TB datasets.
- Engineered scalable infrastructure tailored to complex financial use-cases (Accounting, Regulatory Reporting and FP&A)
- Designed PayPal's payment flow model in BigQuery for regulatory compliance and Analytics usecase
- Led the reconciliation process between SAP ECC and Hadoop-based SOR for several key financial metrics, including Revenue, Customer Liability and Total Payment volume (TPV)
- Developed and implemented the ETL pipeline for PayPal's M & A data from Hive and BigQuery into the SAP HANA Finance Product Subledger to support daily financial close operations.
- Developed a scalable pipeline transferring data from Oracle to Hive and BigQuery using Dataproc and PySpark.
- Collaborated with cross-functional teams to identify and translate business requirements into technical specifications.
- Led a team of 5 data engineers, driving agile delivery and enforcing CI/CD best practices.
Data Engineer
PayPal India
Chennai
01.2019 - 03.2025
- Analyzed user requirements, designed and developed ETL processes to load enterprise data into the Data Warehouse.
- Migration of legacy SQL from Teradata to Hive using spark, Sqoop & TPT
- Developed various Spark jobs using Scala and Spark SQL with proper allocation of executor memory, cores and Driver memory.
- Developed a robust ETL pipeline from external sources like AWS S3, SAP Hana into Hadoop
- Analyzed the data and created proper partitioned/Bucketed hive tables for efficient data processing.
Senior Associate
Cognizant
Chennai
04.2017 - 12.2018
- Developed various HQL jobs to load data from various feeds to Hive tables.
- Monitored the performance of cluster and nodes in Ambari.
- Configuration of file transfer jobs using SFTP/SCP in unix servers
- Created shell scripts to archive data into HDFS
Software Engineer
Mphasis
Chennai
09.2011 - 04.2017
- Involved in design, development and customizations of modules, testing and support of Insurance applications.
- Created database packages, stored procedures, functions and triggers using Oracle PL/SQL.
- Interacted with clients to gather requirements for enhancements.
- Analyzed requirements and provided effort estimation.
- Responsible for writing design documents, user documentations and test plans.
Education
Master of Computer Applications -
RVRJC College of Engineering
Guntur, Andhra Pradesh, India06-2011
Skills
- ETL Development
- BigQuery
- Dataproc
- Python
- Shell Script
- Hadoop
- Spark
- Airflow/UC4/Control-M
- CI/CD
- AWS (S3, Redshift)
- Data lakehouse architecture
- Databrics
- Snowflake
- Cloud Migration
- Technical Leadership
- Effective communication
Certification
- Databrics accredited Generative AI fundamentals
Timeline
Senior Data Engineer
Paypal India Private Limited
04.2025 - Current
Data Engineer
PayPal India
01.2019 - 03.2025
Senior Associate
Cognizant
04.2017 - 12.2018
Software Engineer
Mphasis
09.2011 - 04.2017
Master of Computer Applications -
RVRJC College of Engineering