ailia_llm/axip.ailia_llm/AiliaLLM/getTokenCount

getTokenCount

fun getTokenCount(text: String): Int

Gets the token count for a text.

Return

The number of tokens

Parameters

text

The text to tokenize

Throws

if the operation fails or model not loaded