pyabsa.utils.text_utils.mlm

Functions

get_mlm_and_tokenizer(model, config)

Returns a masked language model (MLM) and a tokenizer for the specified model and config.

Module Contents

pyabsa.utils.text_utils.mlm.get_mlm_and_tokenizer(model, config)

Returns a masked language model (MLM) and a tokenizer for the specified model and config.

Parameters:
  • model – The BERT-like model to use.

  • config – The configuration object to use.

Returns:

A tuple containing the MLM and the tokenizer.