Summary
Overview
Work History
Education
Skills
RECOGNITION
Timeline
Generic

SOUVIK SINHA

Barddhaman

Summary

Experienced AI quality and operations professional specialising in LLM response evaluation, AI safety, and quality auditing. Led teams of Quality and Policy Experts, developed dashboards for tracking performance, and facilitated calibration and coaching. Skilled in assessing model responses for safety, accuracy, relevance, and compliance.

Overview

6
6
years of professional experience

Work History

QUALITY TEAM LEAD & QUALITY AUDITOR

Innodata
10.2025 - 10.2026
  • Led quality operations for AI evaluation projects, overseeing 30–40+ Quality and Policy Experts (QPEs) and reinforcing consistent application of quality standards, policies, and project-specific guidelines.
  • Managed quality assurance across multiple cohorts by reviewing audit outcomes, monitoring evaluator performance, identifying gaps, and reinforcing adherence to established workflows.
  • Conducted quality audits, evaluator shadowing, and calibration sessions to align guideline interpretation and address recurring issues, ensuring consistent evaluations.
  • Analysed audit findings and quality trends to identify error patterns and knowledge gaps, delivering evidence-based feedback and targeted coaching for improvement.
  • Designed and developed Excel-based dashboards consolidating quality scores, productivity targets, and performance metrics, enhancing visibility and streamlining performance monitoring.
  • Supported performance management by monitoring employees on Performance Improvement Plans (PIPs), tracking progress, and helping maintain accountability.
  • Partnered with project leadership and training teams to communicate guideline updates, resolve evaluation discrepancies, and maintain alignment with evolving AI policy requirements.

QUALITY AND POLICY EXPERT

Innodata
08.2025 - 09.2025
  • Audited and evaluated annotator outputs on large-scale AI training data projects, ensuring adherence to complex content policies and resolving ambiguous edge cases to enhance LLM training data quality.
  • Maintained high quality standards, achieving sustained accuracy and reliability across multiple project modules.
  • Identified recurring error patterns across rater submissions and provided structured feedback, fostering inter-rater consistency and calibration standards for hundreds of daily annotations.

AI/LLM ANALYST

Innodata
09.2024 - 07.2025
  • Recognised as a Top Quality Performer within three months on the AI Safety project, reflecting strong evaluation accuracy, policy understanding, and consistent quality delivery.
  • Evaluated prompts and model-generated responses in high-priority AI Safety project for leading global technology company, ensuring safety and policy compliance.
  • Assessed AI-generated content for factual accuracy, relevance, reasoning, and adherence to task-specific criteria, enhancing overall content quality.
  • Identified unsafe outputs, factual inaccuracies, and guideline violations through structured assessments and detailed annotations, contributing to project integrity.
  • Received multiple Spot Awards and Town Hall recognition for quality contributions, performance, and commitment to project delivery.
  • Applied subject knowledge in Biology and Bengali to support assessment creation, subject-knowledge evaluation, and recruitment assessment workflows.

Tutor / Subject Matter Expert

02.2021 - 08.2024
  • Delivered online tutorials for Classes 6–12 and undergraduate Botany; developed subject content, quizzes, assessments, and personalised coaching plans to support student learning outcomes.
  • Tutored students in one-to-one and small group sessions to progress learning.
  • Analysed student progress and prepared feedback to improve test results.

Freelance Event Management

07.2020 - 01.2024
  • Coordinated conferences, seminars, sports events, ceremonies, and business gatherings; led teams of 5–25 in planning, budgeting, promotion, vendor negotiation, quality assurance, logistics, and hospitality to ensure successful event execution.
  • Worked closely with team members to develop strategies for achieving target results.
  • Managed complaints with calm, clear communication and problem-solving.
  • Maintained clean, safe working environments to eliminate accident risks.

Education

B.Sc. (Hons.) - Botany

Burdwan Raj College, Burdwan University
Bardhaman, WB
01-2020

Diploma - IT Application

Youth Computer Training Centre
Bardhaman, WB

Secondary -

West Bengal Council of Higher Secondary Education
Bardhaman, WB

Secondary -

West Bengal Board of Secondary Education
Bardhaman, WB

Skills

  • AI safety compliance
  • Quality auditing
  • Data quality assurance
  • Response evaluation
  • Annotation auditing
  • Excel dashboard development
  • KPI tracking and analysis
  • Root cause analysis
  • Workflow optimisation
  • Evaluator training
  • Stakeholder coordination
  • Operational planning
  • Team leadership and supervision
  • Team supervision
  • Leadership and influence
  • Training development

RECOGNITION

  • Top Quality Performer on AI Safety project within three months
  • Multiple Spot Awards
  • Town Hall recognition

Timeline

QUALITY TEAM LEAD & QUALITY AUDITOR

Innodata
10.2025 - 10.2026

QUALITY AND POLICY EXPERT

Innodata
08.2025 - 09.2025

AI/LLM ANALYST

Innodata
09.2024 - 07.2025

Tutor / Subject Matter Expert

02.2021 - 08.2024

Freelance Event Management

07.2020 - 01.2024

B.Sc. (Hons.) - Botany

Burdwan Raj College, Burdwan University

Diploma - IT Application

Youth Computer Training Centre

Secondary -

West Bengal Council of Higher Secondary Education

Secondary -

West Bengal Board of Secondary Education

Similar Profiles

  • Indira PenemetchaIndira Penemetcha

    <ul><li>- Working in Collaboration with the Central Quality team in the development of Quantitative checklists for Aggregate reports.</li><li>- Performing QR of Safety reports i.e, PADER, DSUR, PBRER and DSURs.</li><li>- Managing QR Team for Safety reports and acting as a training lead for Safety Writing Team.</li><li>- Prepared and Performed QC of the trackers for RSI project.</li><li>- Performed Quality review of cases in Argus database for VOQR project. Created error-free reports and other outputs according to tightly defined specifications to ensure timely reporting of assigned job to program management.</li><li>- Participating in weekly meetings on a regular basis to understand the client's requirement for a particular program and ensure that the team meets or exceeds the targets in terms of quality, quantity within the scope of time constraints</li><li>- Responsible for reviewing the SOPs, job aids as per program specific requirements.</li><li>- Acting as a subject matter expert and helping the team members with day-to-day trouble shooting activities.</li><li>- Signal detection and risk management plan authoring or other assigned PV related activities for client's product(s), per the regulations and SOPs when required.</li><li>- Exhibiting a growing awareness of program strategy and thinking capability alongside independence.</li><li>- Reviewing and providing solutions for issues relating to program delivery or escalating appropriately to the Team Lead / Program Lead as required.</li><li>- Providing standards for gathering information for use in trend analysis.</li><li>- Involved in people development in partnership with PDG leads.</li><li>- Ensuring that all training (internal training and client training) are successfully completed in a timely manner.</li></ul> at Syneos Health<ul><li>- Working in Collaboration with the Central Quality team in the development of Quantitative checklists for Aggregate reports.</li><li>- Performing QR of Safety reports i.e, PADER, DSUR, PBRER and DSURs.</li><li>- Managing QR Team for Safety reports and acting as a training lead for Safety Writing Team.</li><li>- Prepared and Performed QC of the trackers for RSI project.</li><li>- Performed Quality review of cases in Argus database for VOQR project. Created error-free reports and other outputs according to tightly defined specifications to ensure timely reporting of assigned job to program management.</li><li>- Participating in weekly meetings on a regular basis to understand the client's requirement for a particular program and ensure that the team meets or exceeds the targets in terms of quality, quantity within the scope of time constraints</li><li>- Responsible for reviewing the SOPs, job aids as per program specific requirements.</li><li>- Acting as a subject matter expert and helping the team members with day-to-day trouble shooting activities.</li><li>- Signal detection and risk management plan authoring or other assigned PV related activities for client's product(s), per the regulations and SOPs when required.</li><li>- Exhibiting a growing awareness of program strategy and thinking capability alongside independence.</li><li>- Reviewing and providing solutions for issues relating to program delivery or escalating appropriately to the Team Lead / Program Lead as required.</li><li>- Providing standards for gathering information for use in trend analysis.</li><li>- Involved in people development in partnership with PDG leads.</li><li>- Ensuring that all training (internal training and client training) are successfully completed in a timely manner.</li></ul> at Syneos Health

  • RONALD L. STIVERSRONALD L. STIVERS

    Quality Auditor/Lead Auditor at CaterpillarQuality Auditor/Lead Auditor at Caterpillar

  • Nathan RomesburgNathan Romesburg

    Team Lead Quality Control Auditor at Uber FreightTeam Lead Quality Control Auditor at Uber Freight

  • Alina VinnikAlina Vinnik

    Quality Assurance, Deputy Team Lead at Wipro IT ServicesQuality Assurance, Deputy Team Lead at Wipro IT Services

CREATE PROFILE
SOUVIK SINHA