marfrit/rk-llama.cpp
1
0
Fork 0
Code Issues Pull Requests Actions 32 Packages Projects Releases Wiki Activity

Commit Graph

  • 4710dd31bb build : fix build-ios-device (#16257) Adrien Gallouët 2025-09-26 12:39:35 +02:00
  • 9b26511857 ggml-cpu: implement MXFP4 SIMD for s390x (#16193) Aaron Teo 2025-09-26 18:27:25 +08:00
  • 00217cd413 ci : create git tags for released docker images (#16008) Radoslav Gerganov 2025-09-26 13:19:23 +03:00
  • 3b337b01a1 codeowners : add danbev as owner of build-xcframework.sh [no ci] (#16268) Daniel Bevenius 2025-09-26 07:53:36 +02:00
  • a86a580a66 musa: upgrade musa sdk to 4.3.0 (#16240) R0CKSTAR 2025-09-26 08:56:38 +08:00
  • 0f7c69689f musa: fix build warnings (#15611) R0CKSTAR 2025-09-26 08:56:10 +08:00
  • 835b2b915c model : add GroveMoE support (#15510) Sigbjørn Skjæret 2025-09-25 19:50:28 +02:00
  • b05a9d650f vendors: update miniaudio version (#16212) Aaron Teo 2025-09-25 23:38:10 +08:00
  • 27052978e4 readme : update bindings (#16144) rtaluyev 2025-09-25 18:20:34 +03:00
  • 077c94d0ca CUDA: add a fused top-K MoE kernel (#16130) Aman Gupta 2025-09-25 22:35:05 +08:00
  • aa3ee0eb0b model-conversion : add embedding prompt file support (#15871) Daniel Bevenius 2025-09-25 12:02:36 +02:00
  • d0991da39d server : add support for external server for tests (#16243) Daniel Bevenius 2025-09-25 11:36:47 +02:00
  • aa719c2f88 ggml : fix loongarch lsx compilation error (#15864) junchao-zhao 2025-09-25 17:22:55 +08:00
  • 4cdd0bb453 docs: fix typo [no ci] (#16244) Johannes Gäßler 2025-09-25 11:12:27 +02:00
  • b5bd037832 llama : add support for qwen3 reranker (#15824) Douglas Hanley 2025-09-25 03:53:09 -05:00
  • dfcd53f7ec metal : fuse NORM + MUL + ADD, support non-multiples of 4 (#16220) Georgi Gerganov 2025-09-25 11:30:16 +03:00
  • 4ea00794b8 metal : relax reorder conditions (#16216) Georgi Gerganov 2025-09-25 11:29:42 +03:00
  • 02a6a82ae7 metal : restore im2col perf (#16219) Georgi Gerganov 2025-09-25 11:29:08 +03:00
  • c498fc82fe rpc : use ggml logging facilities Radoslav Gerganov 2025-09-25 10:20:02 +03:00
  • e7a5130a20 codeowners: add ownership of zdnn backend [no ci] (#16232) Aaron Teo 2025-09-25 13:06:30 +08:00
  • bee378e098 ci: run the x64 and arm ci on the github machines instead (#16183) Eve 2025-09-25 05:06:06 +00:00
  • 5fb557653b devops: fix s390x docker release failure (#16231) Aaron Teo 2025-09-25 11:36:30 +08:00
  • 4ae88d07d0 codeowners: add ownership of zdnn backend [no ci] (#16229) Aaron Teo 2025-09-25 00:25:04 +08:00
  • e789095502 llama: print memory breakdown on exit (#15860) Johannes Gäßler 2025-09-24 16:53:48 +02:00
  • f2a789e334 ggml : split graph allocations according to backend max buffer size (#15815) Acly 2025-09-24 16:17:49 +02:00
  • 3a59971967 model : add label for LiquidAI LFM2-2.6B model (#16204) Tarek Dakhran 2025-09-24 13:42:26 +02:00
  • 63b54c81a6 model-conversion : make causal-verify-logits fails with model names containing "." (#16215) Jie Fu (傅杰) 2025-09-24 16:25:26 +08:00
  • 152729f884 common : add missing chrono header for common.cpp (#16211) Uilian Ries 2025-09-24 08:53:47 +02:00
  • c0c59c1157 codeowners : match all requirements files (#16214) Sigbjørn Skjæret 2025-09-24 08:53:20 +02:00
  • 7735706b93 model-conversion : run-org-model.py fails to run on mac m1 (#16213) Jie Fu (傅杰) 2025-09-24 14:46:52 +08:00
  • 4d9ea03d17 codeowners : use slash prefix for root files [no ci] (#16210) Daniel Bevenius 2025-09-24 08:10:09 +02:00
  • 8ba548dae2 model-conversion : fix the make targets in the README.md (#16209) Jie Fu (傅杰) 2025-09-24 12:19:23 +08:00
  • f505bd83ca ci : disable AMD workflows + update NVIDIA workflows (#16200) Georgi Gerganov 2025-09-23 20:41:40 +03:00
  • 0889589dbe ci : enable Vulkan workflow on Mac (#16194) Georgi Gerganov 2025-09-23 13:44:25 +03:00
  • 4e29084ba4 ggml-cpu: Respect cpumask settings (#16164) Xiangyan Sun 2025-09-23 01:58:12 -07:00
  • f6b4af3d04 ggml : fix uninitialized is_on_grid in quantize_row_iq3_xxs_impl (#15928) Sigbjørn Skjæret 2025-09-23 10:25:20 +02:00
  • 264f1b5187 zdnn: refactor codebase + add docs (#16178) Aaron Teo 2025-09-23 14:53:05 +08:00
  • 0bc7cc7154 codeowners : add @danbev to model-conversion example [no ci] (#16190) Daniel Bevenius 2025-09-23 08:13:22 +02:00
  • 4b9f4cb0f8 devops: add s390x containers (#15915) Aaron Teo 2025-09-23 13:59:34 +08:00
  • 85e72271ba ggml-cpu : fix typo in gemm comments [no ci] (#16189) Daniel Bevenius 2025-09-23 05:59:03 +02:00
  • 1d0125bcf1 feat: Add conversion support in GraniteHybrid for non-hybrid (all attn) (#16177) Gabe Goodhart 2025-09-22 12:40:10 -06:00
  • 351f3da39c clang-tidy : disable warning about performance enum size (#16127) Haiyue Wang 2025-09-23 01:57:46 +08:00
  • 3ecb2f671a ggml : implement set_rows with i32 index (#16159) Sigbjørn Skjæret 2025-09-22 19:13:00 +02:00
  • 432cf4304c codeowners : update + cleanup (#16174) Georgi Gerganov 2025-09-22 18:20:21 +03:00
  • 37a23c17bd common : enable --offline mode without curl support (#16137) Adrien Gallouët 2025-09-22 14:13:51 +02:00
  • 138c87ce8b webui : fix handling incomplete chunks (#16107) Quentin Bramas 2025-09-22 10:53:13 +02:00
  • c6db9a1027 embedding : fix typos in README (#16171) GideonSerf 2025-09-22 10:49:58 +02:00
  • d05affbab7 common : remove unused local variables (#16140) Haiyue Wang 2025-09-22 16:48:42 +08:00
  • 4f324a556c ggml : extend ggml_can_fuse to work with non-sequential nodes (#16123) Georgi Gerganov 2025-09-22 11:12:37 +03:00
  • a71ae3ba7a ggml : add ggml_op_is_empty (#16122) Georgi Gerganov 2025-09-22 11:12:09 +03:00
  • 05a2458121 codeowners : update ownership for @ngxson and @allozuar (#16128) Xuan-Son Nguyen 2025-09-22 15:10:58 +07:00
  • 96fdca043b Vulkan: add conv_transpose_2d operation (#16022) Shin-myoung-serp 2025-09-22 17:04:01 +09:00
  • b2d980fce0 codeowners : claim responsibility for ci, models, gguf-py and convert (#16124) Sigbjørn Skjæret 2025-09-22 09:59:05 +02:00
  • 5c6106a696 contrib : update roles (#16113) Georgi Gerganov 2025-09-22 10:58:02 +03:00
  • ec65fb52f0 ci : remove vulkaninfo calls (#16169) Georgi Gerganov 2025-09-22 10:16:05 +03:00
  • 1d660d2fae ci : use smaller model (#16168) Georgi Gerganov 2025-09-22 09:11:39 +03:00
  • a20d810d79 vulkan: add RTE variants of exp shader (#16165) Jeff Bolz 2025-09-22 00:37:17 -05:00
  • 4d0a7cbc61 ci : adjust params for less runtime (#16167) Georgi Gerganov 2025-09-22 08:31:40 +03:00
  • 9073a73d82 vulkan: vec dot matrix multiplication fix (#16151) Ruben Ortlam 2025-09-22 07:22:43 +02:00
  • 51f5a45fbe opencl: fix concat crash on win arm64 with Adreno (#15944) lhez 2025-09-21 16:42:10 -07:00
  • c4510dc937 opencl: initial q8_0 mv support (#15732) lhez 2025-09-21 14:48:44 -07:00
  • da30ab5f86 ci : add label for the RISC-V runner (#16150) Georgi Gerganov 2025-09-21 19:00:27 +03:00
  • 28baac9c9f ci : migrate ggml ci to self-hosted runners (#16116) Georgi Gerganov 2025-09-21 16:50:45 +03:00
  • 1eeb523c3e vulkan: optimize UMA buffer operations and fix driver hangs (#16059) Giuseppe Scrivano 2025-09-21 08:31:55 +02:00
  • 5bb4a3edec vulkan: fix validation error about VK_PIPELINE_CREATE_CAPTURE_STATISTICS_BIT_KHR (#16086) Jeff Bolz 2025-09-21 01:23:37 -05:00
  • 7f766929ca sync : ggml Georgi Gerganov 2025-09-20 12:55:47 +03:00
  • 405921dcef ggml : introduce semantic versioning (ggml/1336) Daniel Bevenius 2025-09-16 06:16:52 +02:00
  • fa6383ca7e CUDA : conditionally add cuda architectures (ggml/1341) Gregor Jasny 2025-09-10 17:21:11 +02:00
  • 803dac2e48 vulkan: use vec dot for matrix matrix multiplications (#16056) Ruben Ortlam 2025-09-20 10:42:56 +02:00
  • 459c0c2c1a server: fix SSE and OpenAI compatibility for error messages when streaming (#16109) Benni 2025-09-20 07:56:30 +02:00
  • be79d9fdd9 llama-bench: add --devices and --list-devices support (#16039) ssweens 2025-09-19 15:15:21 -07:00
  • f432d8d83e chat: Fix streaming parser for granite models (#15682) shun095 2025-09-20 00:57:30 +09:00
  • 4067f07fc5 feat: Improve mobile UI for Settings Dialog (#16084) Aleksander Grygier 2025-09-19 09:52:27 +02:00
  • 4b8560ab56 chat : fix build on arm64 (#16101) Xuan-Son Nguyen 2025-09-19 13:02:51 +07:00
  • 0dd58b6877 ggml : refactor forward_dup for cpu backend (#16062) Xuan-Son Nguyen 2025-09-19 11:31:56 +07:00
  • 69ffd89163 ggml-amx : fix ggml_amx_init() on generic Linux (#16049) Adrien Gallouët 2025-09-18 23:07:26 +02:00
  • 246c0d9c79 cmake : fix static linking for OpenMP on Unix-like systems (#16031) Adrien Gallouët 2025-09-18 23:07:18 +02:00
  • 3edd87cd05 opencl: optimize mxfp4 kernels (#16037) Shawn Gu 2025-09-18 12:03:34 -07:00
  • c0b45097c3 rename optimize_graph to graph_optimize (#16082) Jeff Bolz 2025-09-18 13:46:17 -05:00
  • 38dbdf4c05 CUDA: Optimize PAD_REFLECT_1D (#15957) Bowen Han 2025-09-18 11:26:03 -07:00
  • 368560a1e3 CUDA: fix compilation on CC 6.0 (#16091) Johannes Gäßler 2025-09-18 19:28:32 +02:00
  • 4ca088b036 Add resumable downloads for llama-server model loading (#15963) Eric Curtin 2025-09-18 16:22:50 +01:00
  • 703f9e32c4 metal : use function constants for mul_mv_ext kernels (#16074) Georgi Gerganov 2025-09-18 16:28:41 +03:00
  • ad6bd9083b cuda : add missing F32<->I32 entries in ggml_cuda_cpy_fn (#16060) Sigbjørn Skjæret 2025-09-18 13:28:22 +02:00
  • 2b6b55a59f server : include usage statistics only when user request them (#16052) Radoslav Gerganov 2025-09-18 13:36:57 +03:00
  • e58174cecb llama : bump max seq limit from 64 to 256 (#15916) Georgi Gerganov 2025-09-18 12:47:56 +03:00
  • b213fce89b metal : improve F32, F16 and BF16 mat-vec multiplication (#16057) Georgi Gerganov 2025-09-18 12:33:45 +03:00
  • e00f3fd8ff metal : avoid call free for non-owned buffer (#16067) Jhen-Jie Hong 2025-09-18 15:06:48 +08:00
  • f2f28380ea metal : handle nil cv during pipeline creation (#16065) Georgi Gerganov 2025-09-18 10:03:24 +03:00
  • 62c3b645c5 CANN: Remove print (#16044) Chenguang Li 2025-09-18 09:26:33 +08:00
  • d304f459d8 GGML WebGPU: Support for ADD, MUL, RMS_NORM, GET_ROWS operators (#16018) Reese Levine 2025-09-17 13:09:40 -07:00
  • 0320ac5264 metal : refactor + optimize v2 (#15995) Georgi Gerganov 2025-09-17 20:38:12 +03:00
  • a7a98e0fff SvelteKit-based WebUI (#14839) Aleksander Grygier 2025-09-17 19:29:13 +02:00
  • 8f8f2274ee convert : add Llama4ForCausalLM (#16042) Xuan-Son Nguyen 2025-09-18 00:18:21 +07:00
  • c959b676be CUDA: fix FA occupancy, optimize tile kernel (#15982) Johannes Gäßler 2025-09-17 15:32:42 +02:00
  • cd08fc3ecc common : Fix corrupted memory error on json grammar initialization (#16038) David Ribeiro Alves 2025-09-17 01:08:02 -07:00
  • cb5bb6cc05 vulkan: automatically remove unsupported devices (#15976) Eve 2025-09-17 07:35:37 +00:00
  • a91d035b90 ci : revert back to macos-13 for macOS-latest-cmake-x64 (#16040) Daniel Bevenius 2025-09-17 09:34:09 +02:00
  • 745cbcf2fe llama-quant : fix the verification of attention layers for encoder-decoder models (#16023) Jie Fu (傅杰) 2025-09-17 15:30:55 +08:00
  • 1cbd80f8cf examples : support encoder-decoder models in the simple example (#16002) Jie Fu (傅杰) 2025-09-17 15:29:00 +08:00