Reshma C S
Kochi
Summary
Motivated Data Engineering professional with over four years of experience in the Information Technology sector. Proven ability to adapt quickly and effectively in high-pressure environments, consistently meeting tight deadlines. Possesses a strong background in designing and implementing data-driven applications using Big Data technologies such as PySpark, Hive, Spark, HDFS, and Azure cloud platforms.
Overview
4
4
years of professional experience
1
1
Certification
Work History
Hadoop Developer
Cognizant Technology Solutions
07.2021 - Current
- Possess four years of professional experience in the Information Technology domain, specializing in the design, development, and deployment of applications utilizing Big Data technologies, including PySpark, Hive, Spark, HDFS, and Azure cloud infrastructure.
- Developed Spark applications using PySpark within a distributed computing environment to generate curated tables and facilitate data movement from the silver layer to the gold layer, aligned with specific business requirements.
- Performed regular ingestion of large volumes of data from relational databases into HDFS using Sqoop. Additionally, engineered a custom ingestion framework to replace Sqoop by implementing direct data access through JDBC connections and driver credentials, enhancing efficiency and control over data pipelines.
- Involved in converting Hive Queries into various Spark Actions and Transformations by creating Data Frame from the required files in HDFS.
- Worked on reading and writing multiple data formats like JSON, ORC, CSV on HDFS.
- Contributed to the migration of Spark applications from Spark 2 to Spark 3, including the adaptation and optimization of shell scripts and Python files to ensure compatibility and improved performance in the upgraded environment.
- Written Hive queries for data analysis to meet the business requirements.
- Built/worked on enhancements of reusable Data ingestion and Data transformation frameworks using PySpark (Python and Spark) for both CDC and Non-CDC loads.
- Developed Scripts, Batch Jobs, Delay Notification Jobs to automate the workflows using ASG Zena Workstation.
- Demonstrated strong adaptability and problem-solving skills in meeting tight deadlines and overcoming project challenges under pressure.
Education
Master of Technology - Industrial Drives and Control
Rajagiri School of Engineering And Technology
01.2021
Bachelor of Technology - Electrical and Electronics Engineering
Rajagiri School of Engineering And Technology
Kochi, India01.2018
Skills
- PySpark
- Hive
- SQL
- Hadoop
- UNIX Shell Scripting
- HDFS
- GitLab
- Visual Studio
- Microsoft Excel
Accomplishments
- Certificate of Excellence (Q2 2023)
- Stellar Achiever Award (Q1 2024): Strategic Mastermind
- Saphire Award (Q2 2024): Strategic Mastermind
- Saphire Award (Q1 2024): Stellar Achiever in working on multiple projects simultaneously
- Coral Award (Q2 2023): Promising new star
- Silver Award (Q1 2023): Completion of Google Cloud Certification
- Amber Award (Q3 2022) : Excellent Delivery in project activities
Certification
- Google Cloud Platform: Associate Certification
- Databricks: Associate Certification
- Google Cloud Essentials
Language
English
Bilingual or Proficient (C2)
Malayalam
Bilingual or Proficient (C2)
Hindi
Upper intermediate (B2)
Tamil
Intermediate (B1)
Areas of expertise
- PySpark
- Hive
- Hadoop
- GCP
- Databricks
- SQL
Certifications
- Google Cloud Certified: Cloud Digital Engineer
- Google Cloud Certified: Associate Cloud Engineer
- Databricks: Data Engineer Associate
Timeline
Hadoop Developer
Cognizant Technology Solutions
07.2021 - Current
Master of Technology - Industrial Drives and Control
Rajagiri School of Engineering And Technology
Bachelor of Technology - Electrical and Electronics Engineering
Rajagiri School of Engineering And Technology
Similar Profiles
Janardhanan PerumalsamyJanardhanan Perumalsamy
Sr. Executive Support at Cognizant technology Solutions, Cognizant Technology SolutionsSr. Executive Support at Cognizant technology Solutions, Cognizant Technology Solutions
HARSHAVARTHAN N MHARSHAVARTHAN N M
Test Engineer at Cognizant Technology Solutions, CTSTest Engineer at Cognizant Technology Solutions, CTS
Yogeswaran GanesanYogeswaran Ganesan
Associate of Projects at Cognizant Technology Solutions India Private LimitedAssociate of Projects at Cognizant Technology Solutions India Private Limited
Sagnik DasSagnik Das
Programmer Analyst at Cognizant Technology SolutionsProgrammer Analyst at Cognizant Technology Solutions
VENKITESH GVENKITESH G
Clinical Pharmacist at Amrita Institute of Medical SciencesClinical Pharmacist at Amrita Institute of Medical Sciences