marfrit/rosenblatt
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add REPLICATION.md: reproduce rocket-NPU 1GHz LLM accel on vanilla kernel+userspace

Browse Source 
Full recipe: DT (enable rknn cores, OPP table 300-1000MHz, delete assigned-clock-rates),
driver (OPP config + dev_pm_opp_set_rate 1GHz, autosuspend SError mitigation), ggml-rocket
build/run, results (pp512 46.7 vs vendor 51.4, DDR-bandwidth-bound), correctness gate.
Links rk-llama.cpp @ rocket-npu-backend and linux-rk3588-marfrit @ npuclk-opp.
This commit is contained in:
marfrit
2026-07-14 23:41:44 +02:00
parent a2244675b1
commit 27df00a201
2 changed files with 193 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+9
View File
@@ -112,3 +112,12 @@ Headline: mainline driver name is **`rocket`** (not `rknpu`); it's
already shipped in boltzmann's kernel as a built module. Phase-2
unblock is small (DT enable + IOMMU v1.0 mitigation + modprobe),
not a driver port.
## Replicating this work
See **[REPLICATION.md](REPLICATION.md)** for the full recipe (vanilla kernel + userspace):
kernel DT/driver changes for 1 GHz NPU DVFS, the power-domain SError caveat, and
building/running the `ggml-rocket` backend.
- Userspace: [marfrit/rk-llama.cpp](https://git.reauktion.de/marfrit/rk-llama.cpp) branch `rocket-npu-backend` (K>8192: `rocket-ksplit-wip`)
- Kernel: [marfrit/linux-rk3588-marfrit](https://git.reauktion.de/marfrit/linux-rk3588-marfrit) branch `npuclk-opp`