load
fun loadFiles(modelPath: String? = null, vocabPath: String? = null, mergePath: String? = null, dictionaryPath: String? = null)
Loads the resource files required by the tokenizer.
The required files depend on the tokenizer type. See the description of each AILIA_TOKENIZER_TYPE_* constant.
Parameters
model
Path to the SentencePiece model file (spm file), or null if not required.
vocab
Path to the vocabulary file, or null if not required.
merge
Path to the merge file, or null if not required.
dictionary
Path to the MeCab dictionary directory, or null if not required.