---
license: apache-2.0
base_model: Mapika/decider-0.8b
base_model_relation: quantized
pipeline_tag: text-classification
library_name: halogen
# The widget is off deliberately: these files run only on the NPU inside the
# halogen container, so nothing on the Hub can load them.
inference: false
tags:
  - halogen
  - npu
  - ryzen-ai
  - xdna2
  - strix-halo
  - amd
  - classifier
  - guard
  - router
---

<p align="center">
  <img src="halogen.jpg" alt="halogen" width="760">
</p>

# decider-0.8b for the Ryzen AI NPU

[Mapika/decider-0.8b](https://huggingface.co/Mapika/decider-0.8b), a Qwen3.5-0.8B classifier, converted to run on the Ryzen AI NPU of AMD Strix Halo inside
[halogen-flash-server](https://github.com/peonist-ai/halogen-flash-server), beside the Flash model on the GPU and behind
the same port. Questions go to the [Discord](https://discord.gg/bcm6QknaV6).
Bugs go to the server repository's issues.

**These files run only inside the halogen-flash-server container, on the NPU.
They will not load in transformers or any other runtime.**

## What is here

```
devices/              96 MB  the NPU program for this model, and its NOTICE.md
decider-0.8b.hnpw   2.27 GB  the weights, converted for the NPU
tokenizer/            20 MB  the tokenizer
```

## Use it

Start halogen-flash-server 0.16.0 or later with `HALOGEN_DOWNLOAD` on and
`HALOGEN_NPU_MODELS=decider-0.8b`. The server fetches these files into
`/models/npu/decider-0.8b/` and checks each one's size and checksum before it starts.
Give it a text and a question with 2 to 10 options, and it returns a probability for every option from one pass: a guard, a router, a classifier beside the Flash model.

The host needs the NPU driver, XRT with its NPU plugin, and the GPU's fabric
clock held while the NPU works beside the GPU. The setup, every request shape,
and how to run your own fine-tune of this model are in
[docs/NPU.md](https://github.com/peonist-ai/halogen-flash-server/blob/main/docs/NPU.md).

## Source and license

Converted from [Mapika/decider-0.8b](https://huggingface.co/Mapika/decider-0.8b) at revision `a0a01d6f8135298f400a8c856b355793012ae971`, itself a fine-tune of Qwen/Qwen3.5-0.8B-Base. Apache-2.0, as the source.
`devices/NOTICE.md` lists the third-party notices the NPU program carries.