ailia_llm/axip.ailia_llm/AiliaLLM/setSamplingParams

setSamplingParams

fun setSamplingParams(topK: Int, topP: Float, temp: Float, seed: Int)

Sets sampling parameters.

Parameters

topK

The top-k sampling parameter (default: 40)

topP

The top-p sampling parameter (default: 0.9)

temp

The temperature parameter (default: 0.4)

seed

The random seed (default: 1234)

Throws

if the operation fails or model not loaded