Markus Fritsche
a2244675b1
bo_free() (munmap+close) fixes the per-tile mmap leak in rkt_npu_matmul; add rocket_munmap_bo to librocket. rkt_matmul rejects K>8192 (int8 K-limit). Keeps the canonical primitive in sync with the ggml-rocket backend copy in rk-llama.cpp. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01EWpfhDgYNA21tETDP9ueBE
npu-probe
Smallest-possible userspace binary that:
- Opens the NPU device (path TBD per Phase-1 audit)
- Allocates two INT8 input tensors (64×64) + one output (64×64)
- Submits a matmul via the uAPI in use (Tomeu's accel ioctl OR our own shim around vendor MMIO if accel-mainline isn't ready)
- Waits for completion (DMA fence or polled completion register)
- Reads back the output
- Compares to a CPU INT8 matmul reference; reports pass/fail
Phase-1 deliverable. Until this works, nothing else in this repo can be exercised against real silicon.
Build
(filled when Phase-1 audit picks the uAPI shape — meson or cmake,
no autotools)
Run
./npu-probe # default 64×64 INT8 matmul
./npu-probe --shape 128,128,128 # M,N,K override
./npu-probe --device /dev/accel/accel0 # override device path
./npu-probe --golden golden_64x64.bin # provide expected output for diff
Why C, not Python
Direct ioctl + dmabuf + mmap. Python wrapper layer would obscure the exact syscall sequence we need to understand. Once npu-probe works, a Python binding for benchmark scripts is fine.