ailia_llm/axip.ailia_llm/AiliaLLM

AiliaLLM

class AiliaLLM : Closeable

Kotlin binding for ailia LLM library. Provides Large Language Model inference capabilities.

Calls JNI directly from Kotlin without going through Java wrappers.

Constructors

constructor()

Types

object Companion

Functions

open override fun close()

Implements Closeable for use with use { } blocks.

Destroys the AiliaLLM instance and releases resources.

fun generate(): Boolean

Generates one token.

fun getContextSize(): Int

Gets the context size of the model.

fun getDeltaText(): String

Gets the generated text (delta).

getMultimodalCapabilities

fun getMultimodalCapabilities(): AiliaLLMMultimodalCapabilities

Gets the multimodal capabilities of the loaded model.

getPromptTokenCount

fun getPromptTokenCount(): Int

Gets the prompt token count.

fun getTokenCount(text: String): Int

Gets the token count for a text.

fun openModelFile(path: String, nCtx: Int)

Opens a model file.

openMultimodalProjectorFile

fun openMultimodalProjectorFile(path: String)

Opens a multimodal projector file for vision/audio support. Must be called after openModelFile() to enable multimodal capabilities.

fun setPrompt(messages: Array<AiliaLLMChatMessage>)

Sets the prompt for generation.

fun setPrompt(messages: Array<AiliaLLMMultimodalChatMessage>)

Sets the prompt for generation with multimodal support. Automatically detects whether to use text-only or multimodal processing based on the presence of media data.

setSamplingParams

fun setSamplingParams(topK: Int, topP: Float, temp: Float, seed: Int)

Sets sampling parameters.

fun setThinking(enable: Boolean)

Enable or disable thinking (reasoning output). Controls whether thinking models (e.g. Gemma4) output their reasoning process. Must be called before setPrompt.