Dhanshree Lakhase

Client: Citi | Project: C3PO-OPS Client: Citi | Project: OneWealth Data Alchemist

Project Overview: C3PO / C3PO-OPS – Data Engineering & Operations

• Worked on C3PO, a workflow orchestration platform used to design and execute data processing workflows and job pipelines.
• Contributed to C3PO-OPS, a live production project involving client requirements, data processing workflows, and operational dashboards used for data analysis and monitoring.
• Created a workflow using the Kafka component as a source and stored its metadata in a control file in HDFS.Once the Kafka event was received, the file in the S3 bucket was consumed using the File Source component, and the data was subsequently stored using the Hive component.Created an email alert script to check whether the file was present in the S3 location.
• Investigated and resolved production issues reported by clients, performing root-cause analysis and implementing fixes to ensure smooth data pipeline execution.
• Participated in production releases, including deployment of application packages to the production environment, execution of workflows/jobs, and post-deployment validation.
• Gained hands-on experience with AutoSys for enterprise job scheduling, including:
  Creating and configuring AutoSys boxes and jobs.
  Defining job schedules, calendars, timings, and dependencies.
  Creating and modifying JIL files.
  Validating JIL files using JILIN.
  Deploying JIL files to the scheduling environment.
  Monitoring job execution and troubleshooting failures.
  Analyzing STDOUT and STDERR logs for debugging and issue resolution.
• Conducted detailed project knowledge transfer and application analysis by studying Confluence pages, reviewing code, and understanding the overall process flow and working of the project.
• Collaborated with project and operations teams to understand business requirements and translate them into technical workflows and production solutions.

Project Overview: RT1-GT1 SoR Ingestion

• GitHub was used as the coding platform for the project.
• Worked on ingesting regional files with the help of the T1 framework into the Hive staging layer.
• The files were later encrypted and transferred to the Global region using NDM, then decrypted and ingested into the Hive staging layer using the same T1 framework.
• In the Regional-Global ingestion, contributed to approximately 150 files, where control and configuration files were created for the respective files. Created approximately 150 regional and corresponding global AutoSys jobs for scheduling and execution.
• Resolved issues encountered during job execution and ensured successful completion of the ingestion process.
• Worked with Oracle tables as part of the data processing and ingestion requirements.

• Work experience of 1 year working on frontend development using HTML, CSS, JavaScript, Java.
• Worked with team of developers to resolve JS and CSS issues.
• Participated in the initial wave of developers learning and implementing the Angular Library.
• Have experience of working on Xyleme Software for integration and creation of dynamic webpages.