Search ⌘K Start a project →

Security & governance

Red Teaming

Red teaming is deliberately attacking your own AI system to find what breaks first.

It includes planting adversarial documents, crafting injection payloads, and probing for actions a user should not trigger.

Unlike a golden-set eval, which checks normal cases, a red-team suite checks that failure happens safely.

Run once, it is a point-in-time audit; run in CI on every change, it is regression protection for security.

AI Security Review Insight: Prompt injection is a data problem Pattern: Golden-set gate in CI

← Back to the full glossary

Related terms

Guardrails Guardrails are the checks that keep an LLM or agent inside acceptable bounds in production. Prompt Injection Prompt injection is untrusted input crafted to override a model's system prompt or task.

More in Security & governance

Data Processing Agreement (DPA) A DPA is the contract naming a vendor as a processor of personal data. Data Residency Data residency is where data is physically processed and stored, not where users are located. AI Register An AI register is a current list of every system that touches a model. High-Risk AI System A high-risk AI system is one classified as carrying enough decision impact to trigger heavier compliance.

Source: https://customlabs.io/glossary/red-teaming/