Summary
Overview
Work History
Education
Skills
Responsibilities
Languages
Timeline
Generic

B Lavanya Devi

Hyderabad

Summary

I am an experienced analyst with 1 year, 9 months of work on AI evaluation and data annotation projects for Google. I have worked on creating and testing prompts, checking AI answers for accuracy, and tagging data for education, Android, and gaming tasks. I am skilled in evaluating AI responses, following task guidelines, and maintaining high quality. I have good communication skills, work well in a team, and always complete tasks on time. I’m looking for a role where I can learn more, and grow in my career.

Overview

2
2
years of professional experience

Work History

Analyst

Teleperformance
Hyderabad
09.2023 - Current
  • I worked as an Analyst on AI evaluation and data annotation projects for Google.
    Gained 1 year 9 months of experience in prompt engineering, LLM evaluation, and AI testing across educational, mobile, and gaming domains.
    Designed and tested syllabus-based prompts in Google AI Studio (JEE, NEET, UPSC) and evaluated AI responses for accuracy, reasoning, and relevance using rubric-based scoring.
    Performed HumanEval tasks to assess AI-generated answers for clarity, coherence, and logic.
    Tested Android AI assistant behaviors, validating voice commands and app interactions for intent and output accuracy.
    Worked on gaming data annotation, tagging in-game actions and user behavior to train AI models in gameplay understanding.
    Contributed to improving AI model performance, alignment, and real-world usability across platforms.

Education

MBA - Finance

Dr.Br Ambedkar Institute of Management &Technology
Hyderabad
01-2024

Bachelor's Degree - Commerce

Bhavans New Science Arts And Commerce
Hyderabad
01-2021

Intermediate - C.E.C

Sarojini Naidu Vanitha Maha Vidyalaya
Hyderabad
01-2017

Schooling -

Z.P.H School
Rayakuduru
01-2015

Skills

  • Microsoft Office (Word, Excel, PowerPoint)
  • Google Workspace (Docs, Sheets, Gmail)
  • Data Entry and Report Preparation
  • Email and Online Communication Tools
  • Basic Computer & File Management Skills

Responsibilities

  • Prompt Engineering – Creating and optimizing structured prompts for LLMs (Google AI Studio)
  • LLM evaluation – assessing model outputs for accuracy, coherence, reasoning, and relevance
  • Human evaluation (HumanEval) – scoring AI responses based on quality, logic, and completeness
  • Rubric-Based Scoring – Using structured rubrics to consistently evaluate AI-generated content.
  • Android QA testing – validating voice assistant responses, app behaviors, and intent mapping
  • Data annotation – tagging educational, mobile, and gaming data for AI training and analysis
  • Analytical Thinking – Identifying hallucinations, logical gaps, and inconsistencies in AI output.
  • Attention to detail – maintaining high annotation and evaluation accuracy across tasks
  • Documentation and reporting – logging errors, trends, and improvement suggestions for model refinement

Languages

  • Telugu
  • English
  • Hindi

Timeline

Analyst

Teleperformance
09.2023 - Current

MBA - Finance

Dr.Br Ambedkar Institute of Management &Technology

Bachelor's Degree - Commerce

Bhavans New Science Arts And Commerce

Intermediate - C.E.C

Sarojini Naidu Vanitha Maha Vidyalaya

Schooling -

Z.P.H School
B Lavanya Devi