Satyam Tope
Pune
Summary
Accomplished Senior Software Engineer at Persistent Systems with expertise in Python and PySpark. Successfully designed custom connectors and optimized data pipelines, enhancing performance and reliability. Proficient in AWS and Docker, I excel in problem-solving and collaboration, driving impactful solutions in large-scale data integration projects.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Senior Software Engineer
Persistent systems
Pune
07.2022 - Current
- Designed and implemented custom connectors using Python SDK for data integration platforms.
- Developed data processing logic with PySpark to transform and manage large-scale datasets.
- Built CRUD and destination connectors for Apache Iceberg and Hudi, supporting ACID-compliant data pipelines.
- Integrated Spark Structured Streaming with Hudi/Iceberg APIs to facilitate time travel and schema evolution.
- Collaborated with DevOps teams to containerize components using Docker for distributed deployment.
- Authored unit tests, integration tests, and documentation for SDK components and PySpark jobs.
- Participated in performance tuning and optimization of Spark jobs to enhance reliability and efficiency.
Education
Bachelor of Engineering - Electronics And Telecommunications
Dy Patil Pimpri
Pune 07-2022
Skills
- Python programming
- PySpark development
- Oracle
- Kafka
- AWS
- Docker
- Linux
- Shell scripting
- Java
- GCP
- SQL
Accomplishments
- Bravo award
- Udemy top learner
Certification
- Azure AI-900
- GCP - ACE
- StreamSets Yellow Belt
Timeline
Senior Software Engineer
Persistent systems
07.2022 - Current
Bachelor of Engineering - Electronics And Telecommunications
Dy Patil Pimpri
Similar Profiles
Jatin BhatiJatin Bhati
Senior Software Developer at Persistent SystemsSenior Software Developer at Persistent Systems
JOSH LEDEENJOSH LEDEEN
AVP, Senior Client Partner at Persistent SystemsAVP, Senior Client Partner at Persistent Systems
Naman PatelNaman Patel
Senior Software Engineer at Persistent SystemsSenior Software Engineer at Persistent Systems
SOM DUTTSOM DUTT
Principal Domain Expert at Persistent SystemsPrincipal Domain Expert at Persistent Systems
Shivraj SayagaonShivraj Sayagaon
Software Engineer at Xplor Technologies Pvt LtdSoftware Engineer at Xplor Technologies Pvt Ltd