Total 9 Year of experience in IT industry where 7 year of experience across Big Data Hadoop, Datawarehouse, Datalake, Data Modeling PySpark, Spark, Hive, HDFS, Python, Shell script and Linux. Ability to quickly pick up unfamiliar technologies, which in turn allows swiftly diagnosing problems and keeping everything running smoothly. Troubleshooting data related and other technical issues on production.
Project and Team : Synechron Innovation
Project: Cross Property DataLake
Client: PayPal,
Role: Senior Data Engineer
Project: Telecom
Client: Bharti Airtel,
Role: Software Engineer
• Generating reports for the BI team by exporting data into HDFS and Hive using Sqoop.
• Importing, exporting, and transforming large volumes of structured, semi-structured, and unstructured data in HDFS and Hive.
• Monitoring, managing, and analyzing Hadoop process and file to ensure smooth job execution and data integrity.
• Managing incoming data from diverse sources and automating data pipelines to improve operational efficiency.
• Handling job scheduling and resource management using Fair Scheduler for optimized cluster performance.
• Coordinating Hadoop cluster operations and performing troubleshooting and maintenance tasks.
• Working extensively with Linux environments, Apache Tomcat, and SQL database servers for operational support.
• Automating routine tasks, handling support tickets, and resolving issues within defined SLA timelines to ensure service reliability and client satisfaction.
Project: Telecom
Client: Airtel, Aircel, Tata Docomo
Role: Support Engineer
Description: I was responsible for providing end-to-end platform support, data management, and operational excellence across Linux-based environments. The work focused on ensuring data availability, system reliability, and seamless client coordination.
• Loading day end process file means incremental data into oracle database.
• Monitoring application and it’s log files from Linux servers.
• Automating backup scheduling and various operational jobs through custom scripting.
• Providing platform support for Linux-based servers, ensuring high system availability.
• Troubleshooting service and application issues promptly to maintain service continuity.
• Monitoring critical services and server health to prevent potential outages and disruptions.
• Coordinating actively with clients for planned activities, ensuring clear communication and minimal business impact.
• Preparing and maintaining comprehensive documentation, user manuals, End-of-Day (EOD) procedures, and Root Cause Analysis (RCA) reports.
• Managing change processes through effective change management and change coordination practices.
• Handling service outages with a structured approach to minimize downtime and impact.
• Ensuring timely response and resolution of incidents within the agreed SLA, maintaining high service quality standards
Project: Telecom (Bharti Airtel)
DataLake