Skip to content

Exact Match

Exact Match Metric

ExactMatchEvaluationMetric

Bases: BaseEvaluationMetric

Exact match evaluation metric class.

Source code in src/fed_rag/evals/metrics/exact_match.py 
 8
 9
10
11
12
13
14
class ExactMatchEvaluationMetric(BaseEvaluationMetric):
    """Exact match evaluation metric class."""

    def __call__(
        self, prediction: str, actual: str, *args: Any, **kwargs: Any
    ) -> float:
        return float(prediction.lower() == actual.lower())