Summary
Overview
Work History
Education
Skills
Websites
Languages
COURSES
Timeline
Generic
SHIVANSH SRIVASTAVA

SHIVANSH SRIVASTAVA

Summary

Dynamic AI Data Annotator and Prompt Evaluator with extensive experience at Outlier.ai, excelling in multilingual QA and content localization. Proven expertise in data annotation and search evaluation, complemented by exceptional attention to detail. Achieved top-tier calibration scores while enhancing AI model outputs through rigorous evaluation and collaboration.

Overview

6
6
years of professional experience

Work History

Freelance AI Data Annotator & Prompt Evaluator

Multiple Platforms (Outlier.ai, Welocalize, OneForma, Microl, Crowdgen, etc.)
01.2021 - Current
  • Evaluate and rate AI model outputs for RLHF, covering math, coding, content, prompt localization, ambiguity detection, and LaTeX reviews.
  • Conduct side-by-side comparisons (Kepler, Artemis, Cherry) and advanced semantic similarity evaluations (XSTS-R-PI).
  • Perform multilingual QA, Hindi content grading under Invisible Hindi Grow guidelines, and E-E-A-T domain quality checks.
  • Transcribe audio, identify speakers/noise, and classify YouTube shopping behavior (Abasto).
  • Rewrite and structure content for MSN/CM-style gallery articles with localization and context-sensitive storytelling.
  • Cleared multiple certifications (Atlantis, Lyra, Camellia, Cherry, Xylophone Grassland, Kepler) and maintain top-tier calibration scores.

Search & Content Evaluator

GLOBAL CROWDSOURCING PLATFORM (NDA-BOUND)
Remote
08.2019 - 12.2022
  • Evaluated search relevance, spam content, and ad quality across multiple domains.
  • Applied detailed task guidelines to judge user intent and result accuracy.
  • Collaborated with quality teams to improve labeling consistency.

Education

Master of Science -

OP Jindal University
01.2023

Bachelor of Technology -

AMITY UNIVERSITY
01.2020

Skills

  • PROMPT EVALUATION & CATEGORIZATION
  • DATA ANNOTATION (TEXT, AUDIO, IMAGE)
  • HINDI-ENGLISH-FRENCH LOCALIZATION & CULTURAL ADAPTATION
  • SEARCH EVALUATION
  • INTRO CROWD-BASED TRAINING MODULE
  • LINGUISTIC QA TESTING
  • CONTENT MODERATION & TRANSCRIPTION
  • FAMILIAR WITH UHRS, REMOTASKS, LABELBOX, SCALE INTERFACES
  • ATTENTION TO DETAIL & TASK PRECISION

Languages

Hindi, English, French

COURSES

  • PROMPT ENGINEERING FOR LLMS, NOIDA Jan 2020
  • DEEPLEARNING.AI AI DATA ANNOTATION FUNDAMENTALS, INTERNAL PLATFORM TRAINING Jan 2024 - Present

Timeline

Freelance AI Data Annotator & Prompt Evaluator

Multiple Platforms (Outlier.ai, Welocalize, OneForma, Microl, Crowdgen, etc.)
01.2021 - Current

Search & Content Evaluator

GLOBAL CROWDSOURCING PLATFORM (NDA-BOUND)
08.2019 - 12.2022

Master of Science -

OP Jindal University

Bachelor of Technology -

AMITY UNIVERSITY

Similar Profiles

CREATE PROFILE
SHIVANSH SRIVASTAVA