Results-driven Senior Software Engineering Manager with extensive experience in data engineering and sophisticated data management. Expert in optimizing data systems to align with customer needs and managing multiple projects efficiently. Advocates for holistic and collaborative approaches, enhancing operational efficiency and quality. Skilled in providing strategic oversight and hands-on guidance to drive profitability and deliver insights.
● Leading offshore development and support team and ensuring timely delivery of deliverables.
● Worked on creation of QA regression data pipeline, which involved creation of AB initio graphs, reading data from HDFS, writing logic to find difference between baseline data and pipeline data, finding all diff columns and their count in the differences, showing sample keys for adds and deletes, creating excel sheet with summary and detail tabs and mailing same to the stakeholders.
● Worked on migrating Map Reduce jobs to Ab Initio.
● Automated manual deployment step using concourse CI saving more than 1 hour of man hour.
● Analyzed the differences in output of Map reduce and Ab initio jobs after migration and rectified the same.
● Worked on POC of reading streaming data from Kafka queues and publishing it back into Kafka queues using Ab Initio continuous flows functionality.
● Worked on performance improvement of the existing graphs in Ab initio.
● Conducted Ab initio training session for Dev and support team.
● Performed support activities and other functions such as providing hotfix for production failures, analyzing bad data in the records.
● Expert in all ab initio product suite like, control center, Conduct IT, GDE, EME, Continuous flows
● Migrated the entire data masking work to Ab Initio from shell/perl scripts, saving the considerable amount of time, which involved using conduct > IT (Plans), looping subplans and generic graphs.
● Created deterministic and non deterministic masking, data harvesting jobs in Ab Initio.
● Working on the POC of creating a data mining tool with the help of Python.
● Created connection between A>I and AWS RDS, to fetch the records from Maria DB hosted on AWS RDS for the project work.
● Worked on reading data in Ab Initio from various sources such as mainframe, Excel files, flat files.
● Worked on masking XML data in Ab Initio.
● Analyzing business queries which require debugging the code and querying database.
● Worked on enhancements/developments, using Ab Initio creating several graphs and etl jobs.
● Analyzing the failures in the daily batch jobs and creating graphs to solve issues occurred in production wherever possible.
● Handling the audit requirements by providing requested samples of TWS job logs, samples by querying database and other technical information.
● Implemented several performance improvements in graphs and automations.
● Received several appreciations from manager and stakeholders for handling finance application efficiently.
● Worked on AIX to Linux migration of the application, involved in analyzing the requirements, fixing issues and handling MFT setup to transfer the files through and on the new Linux server.
● Involved in grooming the new resources by providing the relevant Ab Initio knowledge.
● Part of project Walgreens team (Retail ISU), handling JAVA side as well as ETL part of the application.
● Worked on several enhancements, designing UI using Java Swings and using Spring framework.
● Worked on enhancements, using Ab Initio creating several graphs and etl jobs to support ETL part of the application.
● Skilled in requirements analysis and project documentation.
● Prepared project plan and estimates sheets for various enhancements.
● Prepared functional and technical documents for various enhancements.
● Prepared JUnits for all the enhancements done.
● Prepared unit test cases and Data Integration test cases for all the ETL enhancements done.
● Prepared weekly status report and monthly status report for the project.
● Appreciation by client for great performance and handling the tasks single handed.
● Worked on migration of Ab initio version 3.0.2 to 3.2.2.
● Successfully led the team, delivering assigned tasks on time.