A Response check evaluates an agent turn. Choose the judge in the check’s Judge using controls.
Settings
Behavior and dependencies
LLM as judge is useful when meaning, tone, or required information matters more than one wording. Exact response is useful for a response that must match a specific string.
Changing the judge creates a new empty expectation for that mode. Re-enter the expected text after changing modes. The editor explicitly states that an empty LLM expectation passes when the agent does not respond; use a meaningful expectation when a reply is required.
Example
Illustrative LLM expectation: “Explain that the customer needs an order number before checking status.”
Illustrative exact response: Please provide your order number.
The first permits different wording. The second checks the specified text.