Accomplished Senior Engineer at Wipro Technologies, specializing in SQL, PySpark, and data ingestion. Demonstrated success in automating batch jobs and mentoring teams, significantly improving operational efficiency. Skilled in managing change requests and providing timely solutions, fostering impactful results in data processing and analytics.
Project : CCR (Citi Connectivity Registry).
Client: CITI
In this, we used to manage the risk assessment, review, and approval process for various third-party and non-third-party connectivity types, like firewall, proxy, etc.
CCR records business projects, maintains the history of all connectivity revisions, and the current business connectivity state.
My roles and responsibilities:
We have ad-hoc and daily running processes, which include data ingestion using SRB, SFT, SFTP, mail, etc.
Unix, Hive, PySpark, and Impala development.
Health check and monitoring of daily batch jobs, as well as downstream delivery and other types of data delivery check.
Supports business with ad-hoc tasks and queries for Cognos reporting.
I was also responsible for complete job monitoring in UAT/PROD, health check.
If there is any issue, we will take necessary actions to get the issue fixed as early as possible and also deploy the changes in UAT/PROD.
Creating a change request and working on it to obtain all the necessary approvals for deploying changes in higher environments.
Client: Pitney Bowes Software Solutions Pvt, Ltd.
Technologies: Hadoop, Sqoop, Hive, Spark.
Domain: Logistics.
Roles and responsibilities:
Roles and Responsibilities: