matchzoo.preprocessors.build_vocab_unit
¶
Module Contents¶
Functions¶
|
Build a |
-
matchzoo.preprocessors.build_vocab_unit.
build_vocab_unit
(data_pack: DataPack, mode: str = 'both', verbose: int = 1) → Vocabulary¶ Build a
preprocessor.units.Vocabulary
given data_pack.The data_pack should be preprocessed forehand, and each item in text_left and text_right columns of the data_pack should be a list of tokens.
- Parameters
data_pack – The
DataPack
to build vocabulary upon.mode – One of ‘left’, ‘right’, and ‘both’, to determine the source
data for building the
VocabularyUnit
. :param verbose: Verbosity. :return: A built vocabulary unit.