Job Description
**Principal Engineer – AI Quality & Evaluation Architecture**
**Role Overview**
Vocera (Stryker) is seeking a Principal Engineer to own end-to-end AI quality across the lifecycle — data, models, prompts, evaluation, deployment, and monitoring. This role will define and scale reliable, measurable, production-grade AI systems across speech, NLP, and GenAI in healthcare.
**Key Responsibilities**
**AI Quality Ownership**
+ Own AI quality across the full lifecycle
+ Define SLAs, KPIs, release gates, and production readiness decisions
**Evaluation & Reliability**
+ Build evaluation frameworks for ASR (WER, latency), NLP (intent/entity), and LLMs/RAG (hallucination, safety, groundedness)
+ Develop benchmarking, regression pipelines, and golden datasets
+ Drive adversarial testing, edge case handling, and failure analysis
**AI Testing Platform**
+ Architect scalable evaluation platforms (offline, regression, A/B, shadow te...
**Role Overview**
Vocera (Stryker) is seeking a Principal Engineer to own end-to-end AI quality across the lifecycle — data, models, prompts, evaluation, deployment, and monitoring. This role will define and scale reliable, measurable, production-grade AI systems across speech, NLP, and GenAI in healthcare.
**Key Responsibilities**
**AI Quality Ownership**
+ Own AI quality across the full lifecycle
+ Define SLAs, KPIs, release gates, and production readiness decisions
**Evaluation & Reliability**
+ Build evaluation frameworks for ASR (WER, latency), NLP (intent/entity), and LLMs/RAG (hallucination, safety, groundedness)
+ Develop benchmarking, regression pipelines, and golden datasets
+ Drive adversarial testing, edge case handling, and failure analysis
**AI Testing Platform**
+ Architect scalable evaluation platforms (offline, regression, A/B, shadow te...
Apply for This Position
Ready to take the next step? Click the button below to submit your application.
Submit Application