Content Relevance Evaluator

Job Summary

A company is looking for a Content Relevance Evaluator, a 100% remote, full-time contract position.

Key Responsibilities

• Review query-document pairs and evaluate their relevance using a standardized rubric
• Interpret user intent by analyzing queries and context to determine relevant outcomes
• Document evaluations clearly and provide feedback for system improvements

Required Qualifications

• 1 - 2+ years of experience in reporting and document management
• Proficiency in search engines and formulating effective search queries
• Familiarity with Python scripting is a plus
• Experience with relevance labeling or content evaluation is preferred
• Ability to work independently with minimal oversight