openMtpModel

fun openMtpModel(path: String, nDraft: Int)

Open an MTP assistant and enable draft/target verification decoding. Call once after openModelFile and before setting a prompt. Supports text generation with CPU/GPU Gemma 4 GGUF and QNN models.

Parameters

nDraft

Number of draft tokens. Must be at least 1; QNN supports up to 3.

path

Matching Gemma 4 assistant GGUF, or assistant .qnn for a QNN target

Throws

if the model is not loaded or the operation fails