Type | Description |
---|---|
EXACT_MATCH | The response value exactly matches the target value. |
CONTAINS_ALL | The response value contains all of the specified target values. |
CONTAINS_ANY | The response value contains any of the specified target values. |
STARTS_WITH | The response value starts with the given target value. |
TOOL_CALLED | The response includes a tool call to the specified target tool. |
TOOL_CALLED_WITH | The response includes a tool call to the target tool with the given arguments. |
Type | Description |
---|---|
LATENCY | The completion latency is below the specified threshold. |
COST | The completion cost is below the specified value. |
Type | Description |
---|---|
NOT | The NOT modifier allows you to invert the assertion so that it must not be true. |
Ignore Case | The Ignore Case modifier enables case-insensitive matching or finding of string values. |
JSON
, the evaluation response will automatically be validated as valid JSON. If the validation fails, the evaluation will also fail.
JSON
, you can use a JSON path to match assertions against specific parts of the response.
Provide the path to the JSON value you want to compare to the target.
Use $
to reference the root object.
This follows the JSON path specification.