Hi, I’m
Sathyanarayanan Orathur
Data Engineer
Chennai,Tamil Nadu
The ones who are crazy enough to think they can change the world, are the ones that do.
Steve Jobs
Summary
Skilled data engineer with 5+ years of expertise in Spark, Kafka, and other distributed computing technologies, building and deploying highly scalable data pipelines for real-time analytics. Proven track record of increasing data accessibility by 30% and reducing processing time by 25%
Overview
6
years of professional experience
3
Languages
Work History
Tata Consultancy ServicesChennai
Senior Data Engineer
06.2021 - 08.2023
Job overview
- Designed and implemented a real-time data pipeline to process semi-structured data by integrating 150 million raw records from 30+ data sources using Kafka and PySpark
- Maintained data pipeline up-time of 99.8% while ingesting streaming and transactional data across 8 different primary data sources using Spark, Kafka, S3, and Snowflake
- Integrated data from multiple sources to provide personalized and timely notifications, reducing customer requests by 30%
- Worked with cloud architect to generate assessments and develop and implement actionable recommendations based on results and reviews.
- Partnered with infrastructure teams on evaluation and feasibility assessments of new systems and technologies.
TeamleaseBangalore
Data Engineer
08.2020 - 06.2021
Job overview
- Ensured high availability and fault tolerance of deployed applications by leveraging Kubernetes' self-healing and load balancing capabilities
- Supported production releases by reviewing code, fixing vulnerabilities raised by Checkmarx, SonarQube, and Black Duck, and ensuring adherence to security best practices
- Designed compliance frameworks for multi-site data warehousing efforts to verify conformity with state, federal and EU data security guidelines
- Migrated 24 TB of historic data from DB2 to Cassandra
ProventeqPune
Data Science Engineer
09.2017 - 05.2020
Job overview
- Increased throughput by 70% by implementing a Kafka-based pipeline that efficiently handles high-volume data streams
- Created an automated chatbots to collect and process potential customer data
- Collaborated closely with the team to fine-tune Spark jobs, proactively troubleshooting errors using Resource Manager and effectively resolving them
- Created and managed Postgres and Elasticsearch Server entities for use in data science modeling and reporting
Education
Sri Sathya Sai Institute of Higher LearningAnantapur, India
Master of Computer Applications from Computer Science And Programming
06.2015 - 04.2017
Sri Sathya Sai Institute of Higher LearningAnantapur, India
Bachelor of Computer Applications from Computer Engineering Technology
06.2012 - 04.2015
Skills
Apache Spark
Hive
Python
SQL
Kafka
Snowflake
AWS
Microservices
NoSQL
System Design
Accomplishments
Awards
- Received "Star of the Quarter" award in TCS
- Top Academic Improvement award in 3rd semester in BCA
- Top Academic Improvement award in 2nd semester in MCA
Appreciation
- Received appreciation from the Leadership for improving the overall system performance by 300% with efficiency while working for FIS Global
Availability
See my work availability
Not Available
Available
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Timeline
Senior Data Engineer
Tata Consultancy Services
06.2021 - 08.2023
Data Engineer
Teamlease
08.2020 - 06.2021
Data Science Engineer
Proventeq
09.2017 - 05.2020
Sri Sathya Sai Institute of Higher Learning
Master of Computer Applications from Computer Science And Programming
06.2015 - 04.2017
Sri Sathya Sai Institute of Higher Learning
Bachelor of Computer Applications from Computer Engineering Technology
06.2012 - 04.2015