matchzoo.preprocessors.bert_preprocessor¶
Bert Preprocessor.
Module Contents¶
-
class
matchzoo.preprocessors.bert_preprocessor.BertPreprocessor(mode:str='bert-base-uncased')¶ Bases:
matchzoo.engine.base_preprocessor.BasePreprocessorBaisc preprocessor helper.
Parameters: mode – String, supported mode can be referred https://huggingface.co/pytorch-transformers/pretrained_models.html. -
fit(self, data_pack:DataPack, verbose:int=1)¶ Tokenizer is all BertPreprocessor’s need.
-
transform(self, data_pack:DataPack, verbose:int=1)¶ Apply transformation on data.
Parameters: - data_pack – Inputs to be preprocessed.
- verbose – Verbosity.
Returns: Transformed data as
DataPackobject.
-