marfrit/rk-llama.cpp
1
0
Fork 0
Code Issues Pull Requests Actions 30 Packages Projects Releases Wiki Activity

Commit Graph

  • d205df6812 server, ui : Add support for HTTP ETags in llama-server (#23701) Markus Tavenrath 2026-05-28 20:21:24 +10:00
  • e8d2567429 docker : add ZenDNN Dockerfile (#23716) Sachin Sharma 2026-05-28 15:10:49 +05:30
  • 09e7b76c93 cuda : fix KQ mask offset integer overflow in fattn MMA kernel (#23610) fairydreaming 2026-05-28 10:55:42 +02:00
  • 48e7eae41c perplexity : fix format specifier in LOG_ERR (#23788) Adrien Gallouët 2026-05-28 09:34:58 +02:00
  • c5229087a5 convert : add FP8 to Q8 conversion (#23250) ynankani 2026-05-28 07:16:17 +00:00
  • e31cdaa0eb ggml: fixed Arm SVE usage bug in vec.h, vec.cpp (#22841) Martin Klacer 2026-05-28 08:04:21 +01:00
  • 491c4d7d2e ci : refactor (#23789) Georgi Gerganov 2026-05-28 09:44:25 +03:00
  • 939a7dd648 Hexagon: OP_GATED_DELTA_NET K>1 support (#23531) ymcki 2026-05-28 14:05:25 +08:00
  • 8ad8aef447 opencl: OP_GATED_DELTA_NET (#23312) ymcki 2026-05-28 12:23:21 +08:00
  • f12cc6d0fa ggml-webgpu: remove legacy constants (#23672) Reese Levine 2026-05-27 14:22:33 -07:00
  • aa50b2c2ae hexagon: add support for Q4_1 in MUL_MAT and MUL_MAT_ID (#23647) Max Krasnyansky 2026-05-27 10:46:11 -07:00
  • c40006a62e ggml-webgpu: Fix how to dispatch WG to some ops (#23750) Masashi Yoshimura 2026-05-28 01:48:12 +09:00
  • c6e4088376 vulkan: Switch MUL_MAT_VEC to 4 K per iteration for F16/32 (#22887) Matt Corallo 2026-05-27 15:19:23 +00:00
  • b36eefc1b3 vulkan: use GL_NV_cooperative_matrix_decode_vector for faster matmul (#23541) Jeff Bolz 2026-05-27 10:18:28 -05:00
  • 837bb6b447 vulkan: add REPEAT op support for f16 to f16. (#23298) l8bloom 2026-05-27 16:59:08 +02:00
  • ba4dd0bc67 ci : move ARM jobs to self-hosted + disable kleidiai mac release (#23780) Georgi Gerganov 2026-05-27 17:22:20 +03:00
  • 617255d437 vendor : update cpp-httplib to 0.46.0 (#23650) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-05-27 10:36:24 -03:00
  • 87b0a60cdd pyproject : add conversion folder and update dependencies (#23746) Sigbjørn Skjæret 2026-05-27 15:06:18 +02:00
  • fda8528aa8 CUDA: restrict PDL to CTK >= 12.3 due to MSVC issues (#23742) Oliver Simons 2026-05-27 14:21:04 +02:00
  • 2d0656fbdd ci : bump cuda release to 13.3 (#23749) Sigbjørn Skjæret 2026-05-27 14:06:08 +02:00
  • 6b4e4bd582 common : fix env names to all have LLAMA_ARG_ prefix (#23778) Georgi Gerganov 2026-05-27 14:52:47 +03:00
  • 9f0e4b14d2 ci : fix windows ccaches (#23777) Georgi Gerganov 2026-05-27 13:54:21 +03:00
  • b3a739c9b6 ci : remove wasm test (#23733) Sigbjørn Skjæret 2026-05-27 12:11:37 +02:00
  • 4d8cc0c56f vulkan: avoid preferring transfer queue on AMD UMA devices (#22455) Winston Ma 2026-05-27 17:48:40 +08:00
  • 0d227ec358 ci : add ccache to server builds + fix undefined sanitizer build (#23763) Georgi Gerganov 2026-05-27 11:45:12 +03:00
  • 1d971bba36 docs : fix duplicated "the" in granitevision and model-conversion docs (#23767) quyentonndbs 2026-05-27 15:34:06 +08:00
  • 9777256c31 convert: add MiniCPM5 tokenizer support (#23384) zhangtao2-1 2026-05-27 13:08:33 +08:00
  • 7085492c6f server : fix the log message when using SSL (#23393) Radoslav Gerganov 2026-05-27 08:06:30 +03:00
  • b4c0549a49 ggml-zendnn : fixed naming of matmul function (#20964) Vladislav 2026-05-27 01:59:35 +03:00
  • 0d18aaa9d1 ci : do not allocate ccache for 3rd-party hosted runners (#23730) Georgi Gerganov 2026-05-26 20:15:01 +03:00
  • 08bc21b459 ci : move [no release] check to dedicated check_release job (#23734) Georgi Gerganov 2026-05-26 19:49:41 +03:00
  • 35a74c8fb9 ci : add [no release] keyword + fix sanitizer builds (#23728) Georgi Gerganov 2026-05-26 19:05:48 +03:00
  • 5190c2ea8d ci : move macos jobs to the apple workflow + fix names (#23721) Georgi Gerganov 2026-05-26 16:57:55 +03:00
  • 7799d31e68 vulkan: optimize conv2d and implement coopmat1 support (#22620) Jeff Bolz 2026-05-26 08:48:05 -05:00
  • 3a3ed153d9 ci : remove vulkan SDK dep from webgpu job (#23718) Georgi Gerganov 2026-05-26 16:40:30 +03:00
  • ef66bfab68 hexagon: add support for CONCAT op (#23648) Max Krasnyansky 2026-05-26 06:20:05 -07:00
  • 678d43d720 ci : move more CPU jobs to self-hosted runners (#23715) Georgi Gerganov 2026-05-26 15:37:40 +03:00
  • ef41a69179 ci : move sanitizer jobs to self-hosted runners (#23713) Georgi Gerganov 2026-05-26 15:22:09 +03:00
  • 3dc7684f39 ci : reduce (disable SYCL and CANN builds/releases) (#23705) Georgi Gerganov 2026-05-26 15:21:21 +03:00
  • dbe9c0c8ce convert : support Gemma4ForCausalLM architecture (#23682) ghleg 2026-05-26 07:00:31 +02:00
  • 6fe90deffa models : Attach Mistral3 NVFP4 weight scales (#23629) Michael Wand 2026-05-26 00:59:59 -04:00
  • 581d020b12 SYCL: implement ggml_sycl_pool_vmm (#22862) Alexey Kopytko 2026-05-26 13:59:00 +09:00
  • 7623de11d9 tests: test-backend-ops -j <N> to run tests in parallel (#23637) Jeff Bolz 2026-05-25 23:57:56 -05:00
  • c9d98295a3 model : add support for talkie-1930-13b (#22596) Niklas Sheth 2026-05-26 00:57:38 -04:00
  • 1506d39e76 ggml-webgpu: Add MMVQ path for Q4/Q8/Q2_K/Q4_K and clean up legacy MUL_MAT pipeline (#23594) Masashi Yoshimura 2026-05-26 12:42:49 +09:00
  • 54121f7325 [WebGPU] Check batch_compute_passes before sending passes when not doing GPU profiling (#23457) Nikhil Jain 2026-05-25 20:32:49 -07:00
  • 192d8ae8b8 CUDA: missing PDL sync for FWHT, better fallback (#23690) Johannes Gäßler 2026-05-26 05:05:51 +02:00
  • 35c9b1f39e metal : add apple device id (#23566) forforever73 2026-05-26 02:05:16 +08:00
  • 4bead4e30d snapdragon: bump toolchain docker to v0.7 to fix ui build issues (#23680) Max Krasnyansky 2026-05-25 10:57:43 -07:00
  • 302e2c2652 ci : reduce PR jobs by matching backend paths (#23675) Georgi Gerganov 2026-05-25 20:54:54 +03:00
  • 328874d054 model: tag ffn_latent as MUL_MAT to fix buft probe (#23664) Pascal 2026-05-25 16:05:04 +02:00
  • c1f1e28d29 CUDA: add fast walsh-hadamard transform (#23615) Aman Gupta 2026-05-25 21:12:10 +08:00
  • 5a4126adc1 ui: fix stop/continue during an agentic loop (#23356) Pascal 2026-05-25 14:18:59 +02:00
  • a4d2d4ae41 convert : add compressed-tensors NVFP4 support (#21095) Michael Wand 2026-05-25 08:16:11 -04:00
  • d161ea7071 sync : ggml Georgi Gerganov 2026-05-25 12:42:28 +03:00
  • 45158f460e ggml : bump version to 0.13.0 (ggml/1510) Georgi Gerganov 2026-05-25 12:40:17 +03:00
  • 22307b3e8b sync : ggml Georgi Gerganov 2026-05-25 12:33:22 +03:00
  • ce5890b5f7 ggml : bump version to 0.12.1 (ggml/1508) Georgi Gerganov 2026-05-25 12:13:21 +03:00
  • b251f74f49 ggml.h: correct ggml_silu_back arg docstring (a=dy, b=x) (ggml/1500) Ori Pekelman 2026-05-21 12:00:16 +00:00
  • fa97041524 ggml-alloc: fix out-of-bounds read in ggml_dyn_tallocr_remove_block (ggml/1492) Dev-X25874 2026-05-21 17:28:08 +05:30
  • ae251b5ff2 TP: fix ggml context size calculation (#22616) Johannes Gäßler 2026-05-25 11:37:25 +02:00
  • 66efd13375 ggml: gguf_init_from_callback and gguf_init_from_buffer (#22341) Gilad S. 2026-05-25 11:33:29 +02:00
  • 6c4cbdc70b server: MTP layer kv-cache should respect draft type ctk (#23646) Aman Gupta 2026-05-25 16:46:23 +08:00
  • 5fdf07e33b ci : update spacemit toolchain url and enhance curl command (#23642) alex-spacemit 2026-05-25 16:43:24 +08:00
  • 062d3115aa ci : fix pre-tokenizer-hashes check (#23651) Sigbjørn Skjæret 2026-05-25 10:41:25 +02:00
  • 314e729347 llama : document that only one on-device state can be saved per sequence (#23520) Tim Neumann 2026-05-25 09:29:28 +02:00
  • d55fb97174 ci : install host compiler on android-ndk build (#23630) Aldehir Rojas 2026-05-25 03:18:08 -04:00
  • 826539ce59 ggml : Parallelize quant LUT init (#23595) Jeff Bolz 2026-05-25 02:15:46 -05:00
  • b96487645c ui: media attachments before text (#23467) Saba Fallah 2026-05-25 08:50:41 +02:00
  • 9627d0f540 vendor : update cpp-httplib to 0.45.1 (#23639) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-05-25 03:45:22 -03:00
  • e2ef8fe42c server: fix checkpoints creation (#22929) jacekpoplawski 2026-05-25 07:56:18 +02:00
  • 6d57c26ef8 perplexity : fix even more integer overflows (#23623) fairydreaming 2026-05-25 07:12:39 +02:00
  • 28123a3937 ci : move most slim jobs to self-hosted runners (#23619) Georgi Gerganov 2026-05-25 08:11:19 +03:00
  • 549b9d8433 ci : update build-self-hosted.yml (#23616) Georgi Gerganov 2026-05-24 18:20:10 +03:00
  • 5d246a792d convert : minor fixes for numpy 2.x (#23571) Sigbjørn Skjæret 2026-05-24 09:51:31 +02:00
  • 63248fc3e3 cmake : fix ui build (#23592) Aldehir Rojas 2026-05-24 03:37:28 -04:00
  • 83eebe9d08 server: add margin for draft model for fit (#23485) Aman Gupta 2026-05-24 14:43:08 +08:00
  • fff63b5108 TP: fix entirely zero-sized slices per device (#23525) Johannes Gäßler 2026-05-24 08:19:33 +02:00
  • f3061116ff opencl: batch profiling to improve speed and prevent memory leaks (#23495) shaofeiqi 2026-05-23 23:11:43 -07:00
  • 1c0f6db545 hexagon: apply repl optimization in flash attn softmax as #22993 (#23455) Yiwei Shao 2026-05-23 19:56:59 -07:00
  • cec51c7a7d snapdragon: update windows toolchain to use hsdk v6.6.0.0 (#23552) Aparna M P 2026-05-24 08:26:41 +05:30
  • b22ff4b7b4 cmake/ui : refactor the build (#23352) Aldehir Rojas 2026-05-23 17:08:22 -04:00
  • c0c7e147e7 requirements : bump torch to 2.11.0 (#23503) Aditya Singh 2026-05-23 09:24:39 -07:00
  • b0df4c0cfd model : add NVFP4 MTP scale tensors (#23563) Michael Wand 2026-05-23 07:30:31 -04:00
  • a497476330 ggml : Check the right iface method before using the fallback 2d get (#23514) dskwe 2026-05-23 18:49:24 +08:00
  • 95405ac65f vulkan: fix windows find_package of SPIRV-Headers (#23215) Jeff Bolz 2026-05-23 02:44:46 -05:00
  • 0f3cb3fc8b opencl: generalize Adreno MoE kernels on M (#23449) Shawn Gu 2026-05-22 17:08:41 -07:00
  • 1acee6bf89 server: only parse empty msg if continuing an assistant msg (#23506) Aldehir Rojas 2026-05-22 11:58:15 -04:00
  • ef570f6308 perplexity : fix integer overflow (#23496) fairydreaming 2026-05-22 14:50:44 +02:00
  • cc9e331213 SYCL: improve MoE prefill throughput (#23142) Alexey Kopytko 2026-05-22 21:50:17 +09:00
  • bcfd1989e9 sycl : Level Zero detection in ggml_sycl_init (#23097) Alexey Kopytko 2026-05-22 21:49:45 +09:00
  • 56f16f235c SYCL : gated_delta_net K>1 (#23174) karavayev 2026-05-22 08:48:56 -04:00
  • 8cc67efcd4 SYCL: add BF16 to DMMV kernel path (~4x tg speedup on Intel Arc) (#21580) Katostrofik 2026-05-22 08:48:24 -04:00
  • 95feeab52e docs: Update documentation with Granite 4.0/4.1 (#23404) Jesus Talavera 2026-05-22 14:35:46 +02:00
  • 99d4026b11 ggml-zendnn : add Q8_0 quantization support (#23414) Sachin Sharma 2026-05-22 16:46:55 +05:30
  • 9c92e96a64 cmake : build router app only during standalone builds (#23521) fairydreaming 2026-05-22 11:55:29 +02:00
  • afcda09d15 vocab : fix HybridDNA tokenizer (#23466) Kashif Rasul 2026-05-22 11:17:31 +02:00
  • bbce619adb cmake : add install() for impl libraries + fix apple builds (#23511) Georgi Gerganov 2026-05-22 11:46:26 +03:00
  • 4f0e43da6f CUDA: fix PDL CC check for JIT compilation (#23471) Johannes Gäßler 2026-05-21 23:35:29 +02:00
  • bb28c1fe24 cmake : remove STATIC from impl libraries, enable LLAMA_BUILD_APP by default (#23462) Georgi Gerganov 2026-05-21 21:13:59 +03:00