Job Description
- Lead and manage a team of QAs within the assigned project domain (Audio / Video / LLM), ensuring quality objectives and SLAs are consistently met.
- Develop and standardize QA rubrics, error typologies, and review guidelines based on project-specific annotation requirements.
- Conduct calibration sessions regularly with QAs, Trainers, and PMs to maintain consistent quality interpretations across teams.
- Analyze QA reports and annotation error trends to identify systemic issues and recommend corrective actions.
- Collaborate with Trainers to translate recurring quality gaps into targeted training or retraining plans.
- Perform quality audits on both QA and annotator performance to ensure review accuracy and reliability.
- Monitor and report key quality metrics (Accuracy, Consistency, Disagreement Rate, Rejection Rate, etc.) to stakeholders.
- Design and optimize QA sampling strategies to ensu...
Apply for This Position
Ready to take the next step? Click the button below to submit your application.
Submit Application