Skip to content

Assertions

Custom assertion helpers for russo test results.

_assertions

Custom assertion helpers for russo test results.

ToolCallAssertionError 

ToolCallAssertionError(result: EvalResult, message: str = '')

Bases: AssertionError

Rich assertion error with detailed tool call diff.

Source code in src/russo/_assertions.py 
11
12
13
14
15
def __init__(self, result: EvalResult, message: str = "") -> None:
    self.result = result
    detail = result.summary()
    full_message = f"{message}\n{detail}" if message else detail
    super().__init__(full_message)

assert_tool_calls 

assert_tool_calls(result: EvalResult, *, message: str = '') -> None

Assert that an EvalResult passed.

Raises a ToolCallAssertionError with a rich diff if it didn't.

Usage

result = await russo.run(...) russo.assert_tool_calls(result)

Or with a custom message

russo.assert_tool_calls(result, message="Flight booking should work")

Source code in src/russo/_assertions.py 
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
def assert_tool_calls(
    result: EvalResult,
    *,
    message: str = "",
) -> None:
    """Assert that an EvalResult passed.

    Raises a ToolCallAssertionError with a rich diff if it didn't.

    Usage:
        result = await russo.run(...)
        russo.assert_tool_calls(result)

        # Or with a custom message
        russo.assert_tool_calls(result, message="Flight booking should work")
    """
    if not result.passed:
        raise ToolCallAssertionError(result, message)