Labeler / Annotator – Ai Response Evaluation (Italian)

RemoteAbout the RoleWe are seeking a detail‐oriented Labeler / Annotator to evaluate responses generated by AI systems in Italian.This role focuses on side‐by‐side (SBS) evaluation of outputs from different AI models across real‐world scenarios.You will play a key role in improving how AI systems understand and communicate in Italian.This is not a translation role; it is an evaluation andanalysis role requiring strong judgment and attention to detail.What You'll Work OnYou will evaluate AI responses across scenarios such as:Web search resultsFile‐based and image‐based responsesImage and file generation tasksSingle‐turn and multi‐turn conversationsResponsibilitiesPerform side‐by‐side (SBS) comparisons of AI‐generated responsesEvaluate outputs based on:AccuracyRelevanceClarityInstruction‐followingIdentify nuances in tone, meaning, and cultural context across ItalianApply detailed, scenario‐specific annotation guidelinesMaintain consistency and high‐quality evaluationsRequired Qualific...