mmlearn.tasks package

Modules for pretraining, downstream and evaluation tasks.

Submodules

• mmlearn.tasks.base module
  • TrainingTask
    • TrainingTask.configure_optimizers()
• mmlearn.tasks.contrastive_pretraining module
  • AuxiliaryTaskSpec
    • AuxiliaryTaskSpec.loss_weight
    • AuxiliaryTaskSpec.modality
    • AuxiliaryTaskSpec.task
  • ContrastivePretraining
    • ContrastivePretraining.configure_model()
    • ContrastivePretraining.encode()
    • ContrastivePretraining.encoders
    • ContrastivePretraining.evaluation_tasks
    • ContrastivePretraining.forward()
    • ContrastivePretraining.heads
    • ContrastivePretraining.modality_loss_pairs
    • ContrastivePretraining.on_before_zero_grad()
    • ContrastivePretraining.on_load_checkpoint()
    • ContrastivePretraining.on_save_checkpoint()
    • ContrastivePretraining.on_test_epoch_end()
    • ContrastivePretraining.on_test_epoch_start()
    • ContrastivePretraining.on_train_epoch_start()
    • ContrastivePretraining.on_validation_epoch_end()
    • ContrastivePretraining.on_validation_epoch_start()
    • ContrastivePretraining.postprocessors
    • ContrastivePretraining.test_step()
    • ContrastivePretraining.training_step()
    • ContrastivePretraining.validation_step()
  • EvaluationSpec
    • EvaluationSpec.run_on_test
    • EvaluationSpec.run_on_validation
    • EvaluationSpec.task
  • LossPairSpec
    • LossPairSpec.modalities
    • LossPairSpec.weight
  • ModuleKeySpec
    • ModuleKeySpec.encoder_key
    • ModuleKeySpec.head_key
    • ModuleKeySpec.postprocessor_key
• mmlearn.tasks.hooks module
  • EvaluationHooks
    • EvaluationHooks.evaluation_step()
    • EvaluationHooks.on_evaluation_epoch_end()
    • EvaluationHooks.on_evaluation_epoch_start()
• mmlearn.tasks.ijepa module
  • IJEPA
    • IJEPA.configure_model()
    • IJEPA.on_before_zero_grad()
    • IJEPA.on_load_checkpoint()
    • IJEPA.on_save_checkpoint()
    • IJEPA.on_test_epoch_end()
    • IJEPA.on_test_epoch_start()
    • IJEPA.on_validation_epoch_end()
    • IJEPA.on_validation_epoch_start()
    • IJEPA.test_step()
    • IJEPA.training_step()
    • IJEPA.validation_step()
• mmlearn.tasks.zero_shot_classification module
  • ClassificationTaskSpec
    • ClassificationTaskSpec.query_modality
    • ClassificationTaskSpec.top_k
  • ZeroShotClassification
    • ZeroShotClassification.evaluation_step()
    • ZeroShotClassification.on_evaluation_epoch_end()
    • ZeroShotClassification.on_evaluation_epoch_start()
• mmlearn.tasks.zero_shot_retrieval module
  • RetrievalTaskSpec
    • RetrievalTaskSpec.query_modality
    • RetrievalTaskSpec.target_modality
    • RetrievalTaskSpec.top_k
  • ZeroShotCrossModalRetrieval
    • ZeroShotCrossModalRetrieval.evaluation_step()
    • ZeroShotCrossModalRetrieval.on_evaluation_epoch_end()
    • ZeroShotCrossModalRetrieval.on_evaluation_epoch_start()