atomgen.models.configuration_atomformer module#
Configuration class for Atomformer.
- class AtomformerConfig(vocab_size=123, dim=768, num_heads=32, depth=12, mlp_ratio=1, k=128, dropout=0.0, mask_token_id=0, pad_token_id=119, bos_token_id=120, eos_token_id=121, cls_token_id=122, **kwargs)[source]#
Bases:
PretrainedConfigConfiguration of a
AtomformerModel.It is used to instantiate an Atomformer model according to the specified arguments.
- model_type: str = 'atomformer'#