AiliaLLMModel class

Constructors

AiliaLLMModel.new()

Properties

dllHandle ↔ dynamic
getter/setter pair
hashCode → int
The hash code for this object.
no setterinherited
pLLm ↔ Pointer<Pointer<AILIALLM>>
getter/setter pair
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited

Methods

close() → void
Free memory allocated natively.
contextFull() → bool
generate() → String?
Ask the model to generate the next token. This function properly handle incomplete multi-byte utf8 character.
getMultimodalCapabilities() → Map<String, bool>
getTokenCount(String text) → int
noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
open(String modelPath, int nCtx, {String backend = ""}) → void
Initialize the context using the given model and parameters.
openMultimodalProjectorFile(String mmprojPath) → void
setMultimodalPrompt(List<Map<String, dynamic>> messages) → void
Set multimodal prompt for generation with media attachments.
setPrompt(List<Map<String, dynamic>> messages) → void
Set the prompt to be processed by the model. The prompt will be formatted according to the selected format.
setSamplingParams(int top_k, double top_p, double temp, int dist) → void
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited

Static Methods

checkVulkanVersion() → bool
getBackendList() → List<String>