ailia Tracker

Getting Started

Choose your platform and track objects across video frames with YOLOX-S detection plus ByteTrack association.

Get Evaluation Package

Apply for the free trial to obtain the evaluation package, which contains the C++ binding, runtime libraries, and the license file.

Apply for Free Trial

Download Models & Build

Download the YOLOX-S detector model and place it next to the binary, then build and run the sample.

# Download model files into the binary folder
curl -O https://storage.googleapis.com/ailia-models/yolox/yolox_s.opt.onnx
curl -O https://storage.googleapis.com/ailia-models/yolox/yolox_s.opt.onnx.prototxt

# Build (macOS)
clang++ -o ailia_tracker_sample ailia_tracker_sample.cpp \
  libailia.dylib libailia_audio.dylib \
  libailia_tokenizer.dylib libailia_tracker.dylib \
  -Wl,-rpath,./ -std=c++17

./ailia_tracker_sample input.mp4

Full C++ Setup Guide

Install via UPM

Open Window > Package Manager in Unity (2021.3.10f1+), click + > Add package from git URL, and enter the binding URL below.

https://github.com/ailia-ai/ailia-tracker-unity.git

Unity API Reference

Run a Sample

Clone ailia-models-unity, open it in the Unity Editor (2021.3.10f1+), and play ObjectTracking/ObjectTrackingSample.unity with a video clip or webcam input. Bounding boxes with stable IDs are overlaid in the Game view.

git clone https://github.com/ailia-ai/ailia-models-unity.git

Sample Scene

Clone Binding

Clone the JNI binding repository and add it to your Android Studio project.

git clone https://github.com/ailia-ai/ailia-tracker-jni.git

Binding

Run a Sample

Clone ailia-models-kotlin with submodules and open it in Android Studio. Run the tracker sample on a connected device — it pairs YOLOX-S detection with ByteTrack association on each video frame.

git clone https://github.com/ailia-ai/ailia-models-kotlin.git
cd ailia-models-kotlin
git submodule update --init --recursive

AiliaTrackerSample.kt

System Requirements

ailia Tracker runs on desktop and mobile platforms. GPU acceleration is available for the object-detection phase on Windows and Linux.

Operating Systems

Windows 10 / 11
macOS 11 or later
Linux (Ubuntu 20.04+)
iOS 13+ / Android 7+

Languages & Compilers

C++17 (VS 2019+ / Xcode 14.2+ / clang) + CMake
C# / Unity 2021.3.10f1+
Kotlin / Java (JNI)

Bundled Models

YOLOX-S (object detection)
ByteTrack (object tracking)
80 COCO categories

Input / Output

Video file or webcam input
MP4 output (annotated)
Tracking ID, category, confidence
Bounding box (x / y / w / h)

Use the API in Your Project

Minimal examples for adding ByteTrack association on top of your detector in your own application.

#include "ailia_tracker.h"

struct AILIATracker *tracker = nullptr;
AILIATrackerSettings settings = {0.1f, 0.7f, 0.5f, 30, 0.8f};
ailiaTrackerCreate(&tracker, AILIA_TRACKER_ALGORITHM_BYTE_TRACK, &settings);

for (auto &d : detections) {
    ailiaTrackerAddTarget(tracker, d.category, d.prob, d.x, d.y, d.w, d.h);
}
ailiaTrackerCompute(tracker);

unsigned int n; ailiaTrackerGetObjectCount(tracker, &n);
ailiaTrackerDestroy(tracker);

using ailiaTracker;

var tracker = new AiliaTrackerModel();
tracker.Open(AiliaTracker.AILIA_TRACKER_ALGORITHM_BYTE_TRACK,
             scoreThreshold: 0.1f, nmsThreshold: 0.7f,
             trackThreshold: 0.5f, trackBuffer: 30, matchThreshold: 0.8f);

foreach (var d in detections) {
    tracker.AddTarget(d.category, d.confidence, d.x, d.y, d.w, d.h);
}
tracker.Compute();

for (int i = 0; i < tracker.GetObjectCount(); i++) {
    var obj = tracker.GetObject(i);
}

val tracker = AiliaTracker(
    algorithm = AiliaTracker.AILIA_TRACKER_ALGORITHM_BYTE_TRACK,
    settings = AiliaTrackerSettings(
        score_threshold = 0.1f, nms_threshold = 0.7f,
        track_threshold = 0.5f, track_buffer = 30,
        match_threshold = 0.8f,
    ),
)

for (d in detections) {
    tracker.addTarget(d.category, d.confidence, d.x, d.y, d.width, d.height)
}
tracker.compute()

for (i in 0 until tracker.getObjectCount()) {
    val o = tracker.getObject(i)
}
tracker.close()

API Reference by Platform

C++

Unity

API
Binding

JNI

Binding

FAQ

Common questions about ailia Tracker.

What models does ailia Tracker use under the hood?

YOLOX-S handles per-frame object detection across the 80 COCO categories, and ByteTrack associates detections into stable tracking IDs across frames.

Where do I download the model files?

YOLOX-S weights and prototxt:

yolox_s.opt.onnx
yolox_s.opt.onnx.prototxt

Place both files in the same folder as the sample binary.

How do I track only one category, e.g. people?

Each AILIATrackerObject has a category attribute (integer matching the COCO label). Filter results in your code — e.g. keep only category == 0 to track humans, or build a small lookup map for the labels you care about.

What output information does the tracker produce?

For each tracked object: id (stable across frames), category, detection prob, and a normalized bounding box (x, y, w, h) where 0 maps to the left/top edge and 1 maps to the right/bottom edge.

Does it work with a webcam?

Yes. Pass -w <index> to the C++ sample to use a webcam stream instead of a file. The Unity binding exposes the same camera-input mode through its ailia-tracker-unity package.

How do I enable GPU acceleration?

On macOS / iOS, Metal is used automatically. On Windows / Linux, install CUDA Toolkit and cuDNN. See the CUDA Toolkit / cuDNN Installation Guide for detailed instructions. Acceleration applies to the object-detection phase; ByteTrack association runs on CPU.

How does licensing work?

The C++ binding requires ailia.lic from the evaluation package, placed next to the runtime libraries:

Windows: same folder as ailia.dll.
macOS: ~/Library/SHALO/
Linux: ~/.shalo/

Unity and JNI bindings auto-download the evaluation license on first run. For commercial deployment, request a production license. See the ailia license terms.

Getting Started

Get Evaluation Package

Download Models & Build

Install via UPM

Run a Sample

Clone Binding

Run a Sample

System Requirements

Operating Systems

Languages & Compilers

Bundled Models

Input / Output

Features

Detection & Association

Tracking Output

Filtering

GPU Acceleration

Use the API in Your Project

API Reference by Platform

C++

Unity

JNI

FAQ

Materials