Riyaz Shaik
Cloud Data Engineer
Summary
Dynamic Cloud Data Engineer with a proven track record at Tata Consultancy Services, specializing in AWS and Snowflake. Successfully led a team to implement a production monitoring system, reducing downtime by 20%. Adept at optimizing ETL processes and fostering collaboration, enhancing data integrity and team productivity through effective communication and technical mentorship.
Overview
4
4
years of professional experience
Work History
Cloud Data Engineer
Tata Consultancy Services
Hyderabad, India
06.2023 - Current
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors.
- Migrated legacy systems to modern big-data technologies, improving performance and scalability while minimizing business disruption.
- Collaborated with system architects, design analysts and others to understand business and industry requirements.
- Provided technical guidance and mentorship to junior team members, fostering a collaborative learning environment within the organization.
- Conducted extensive troubleshooting to identify root causes of issues and implement effective resolutions in a timely manner.
- Established robust monitoring processes to detect system anomalies.
- Collaborated with cross-functional teams for seamless integration of data sources into the company''s data ecosystem.
- Led a team of 10 engineers to implement a new production monitoring system, resulting in a 20% reduction in downtime.
- Developed and implemented process improvements that reduced production cycle time by 15%.
Senior Software Engineer
Foraysoft
Hyderabad,India
02.2022 - 06.2023
- Monitored data transfer from OLTP systems to Kafka using Qlik Replicate servers, supporting connection string changes during database switchover.
- Led and managed a cross-functional team, ensuring alignment with organizational goals and project objectives. Delegated tasks effectively, optimizing team members' strengths and skills.
- Facilitated clear communication between team members, stakeholders, and leadership.
- Monitored the data domain pipeline through Astronomer, and verified it through Snowflake.
- Ensured all daily files were received by the system through an AWS S3 bucket, and checked successful Airflow runs to process data from S3 to Snowflake; debugged any failures.
- Performed audit checks to ensure target tables maintained a minimum threshold of data, preventing client data loss.
- Ran reports for data ingestion to Snowflake target tables, ensuring correct and timely data. Checked data counts in Snowflake, and performed checks to ensure data from Ctrl-M jobs were successfully copied to the target.
Education
B.E -
SRKR Engineering College
Bhimavaram, India 04.2001 -
Intermediate -
Narayana Junior College
Ongole, India 04.2001 -
SSC -
Sivani Public School
Ongole, India 04.2001 -
Skills
AWS
SQL
SNOWFLAKE
QLIK REPLICATE
AIRFLOW
Prompt Engineering
GEN AI
AI AGENTS
Timeline
Cloud Data Engineer
Tata Consultancy Services
06.2023 - Current
Senior Software Engineer
Foraysoft
02.2022 - 06.2023
B.E -
SRKR Engineering College
04.2001 -
Intermediate -
Narayana Junior College
04.2001 -
SSC -
Sivani Public School
04.2001 -