marfrit/rk-llama.cpp
1
0
Fork 0
Code Issues Pull Requests Actions 33 Packages Projects Releases Wiki Activity
1 Commit 6 Branches 0 Tags
26c084662903ddaca19bef982831bfb0856e8257
T
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Georgi Gerganov 26c0846629 Initial release
2023-03-10 20:56:40 +02:00
.gitignore
Initial release
2023-03-10 20:56:40 +02:00
convert-pth-to-ggml.py
Initial release
2023-03-10 20:56:40 +02:00
ggml.c
Initial release
2023-03-10 20:56:40 +02:00
ggml.h
Initial release
2023-03-10 20:56:40 +02:00
main.cpp
Initial release
2023-03-10 20:56:40 +02:00
Makefile
Initial release
2023-03-10 20:56:40 +02:00
quantize.cpp
Initial release
2023-03-10 20:56:40 +02:00
utils.cpp
Initial release
2023-03-10 20:56:40 +02:00
utils.h
Initial release
2023-03-10 20:56:40 +02:00
S
Description
llama.cpp with RK3588 NPU (rknpu2 vendor backend) — perf-rknpu2 optimization branch
MIT 336 MiB
Languages
C++ 45.2%
JavaScript 19.8%
C 10.9%
Python 6.2%
Cuda 4.7%
Other 13%