mmlearn.tasks.contrastive_pretraining.EvaluationSpec

class EvaluationSpec(task, run_on_validation=True, run_on_test=True)

Bases: object

Specification for an evaluation task.

Methods

Attributes

run_on_test: bool = True

Whether to run the evaluation task during training.

run_on_validation: bool = True

Whether to run the evaluation task during validation.

task: Any

The evaluation task module. This is expected to be an instance of EvaluationHooks.