Evaluation
Shadow Deployment
Also known as shadow testing, dark launch
A shadow deployment runs a candidate release against real production traffic, offline, before release.
It compares its output to the live system's, without ever showing a real user the result.
It is a step beyond a golden-set eval, checking behavior against this week's actual input distribution.
It catches a regression the golden set never thought to test for, before a real user sees it.
← Back to the full glossaryRelated terms
More in Evaluation
Eval Suite (Evals) An eval suite is a versioned set of test cases that measures whether outputs are good. LLM-as-Judge LLM-as-judge uses another LLM to score a model's outputs against a rubric, at scale. Hallucination A hallucination is a confident, fluent output that is factually wrong or unsupported. Prompt Injection Prompt injection is untrusted input crafted to override a model's system prompt or task.