Skip to content

Evals

Exceptions for Evals.

EvalsError

Bases: FedRAGError

Base evals error for all evals-related exceptions.

Source code in src/fed_rag/exceptions/evals.py 
6
7
8
9
class EvalsError(FedRAGError):
    """Base evals error for all evals-related exceptions."""

    pass

EvalsWarning

Bases: FedRAGWarning

Base inspector warning for all evals-related warnings.

Source code in src/fed_rag/exceptions/evals.py 
12
13
14
15
class EvalsWarning(FedRAGWarning):
    """Base inspector warning for all evals-related warnings."""

    pass

BenchmarkGetExamplesError

Bases: EvalsError

Raised if an error occurs when getting examples for a benchmark.

Source code in src/fed_rag/exceptions/evals.py 
18
19
20
21
class BenchmarkGetExamplesError(EvalsError):
    """Raised if an error occurs when getting examples for a benchmark."""

    pass

BenchmarkParseError

Bases: EvalsError

Raised when errors occur during parsing examples.

Source code in src/fed_rag/exceptions/evals.py 
24
25
26
27
class BenchmarkParseError(EvalsError):
    """Raised when errors occur during parsing examples."""

    pass

EvaluationsFileNotFoundError

Bases: EvalsError, FileNotFoundError

Benchmark evaluations file not found error.

Source code in src/fed_rag/exceptions/evals.py 
30
31
32
33
class EvaluationsFileNotFoundError(EvalsError, FileNotFoundError):
    """Benchmark evaluations file not found error."""

    pass