williams
  • Joined on 2026-05-30
williams created repository marfrit/llm-proxy 2026-07-24 06:03:11 +00:00
williams commented on issue marfrit/claude-his-agent#9 2026-07-22 21:23:08 +00:00
dspark cluster runs SINGLE-RAIL: NCCL_IB_HCA prefix excludes the second 200G rail (bosch<->escher)

Correction to the premise above (markus, verified by web research)

~200 Gbit/s is the TOTAL for a DGX Spark, not per rail. Both QSFP ports share the same two PCIe Gen5 x4 links to the…

williams opened issue marfrit/sic#1 2026-07-22 21:05:10 +00:00
sic swallows a bare --, breaking every nested command that needs one
williams opened issue marfrit/claude-his-agent#9 2026-07-22 16:51:46 +00:00
dspark cluster runs SINGLE-RAIL: NCCL_IB_HCA prefix excludes the second 200G rail (bosch<->escher)
williams opened issue marfrit/claude-his-agent#8 2026-07-22 13:39:00 +00:00
dcw2: agent-container storage is a USB flash drive that dropped off the bus (btrfs went read-only, host rebooted)
williams pushed to main at williams/llmproxy 2026-07-20 22:14:43 +00:00
6cbf352851 llm-proxy: propagate client cancellation to the backend (free the slot)
williams pushed to main at williams/llmproxy 2026-07-20 11:50:21 +00:00
06f20ae752 llm-proxy: per-backend admission gate (semaphore, bounded queue, 503 on saturation)
williams pushed to main at williams/llmproxy 2026-06-15 13:12:30 +00:00
c121428c58 Initial commit: Boltzmann LLM proxy with compression + classifier middleware
williams created branch main in williams/llmproxy 2026-06-15 13:12:30 +00:00
williams created repository williams/llmproxy 2026-06-15 13:11:41 +00:00
williams pushed to main at williams/nash-mem0 2026-06-12 14:38:22 +00:00
cee2e50836 Fix UI indentation error – add copy-id button
williams pushed to main at williams/nash-mem0 2026-06-12 13:06:10 +00:00
ca8b74d724 Add copy id button next to delete button in web UI
williams created pull request marfrit/lmcp#26 2026-06-05 15:52:00 +00:00
Add nash memory tools as lmcp plugin
williams pushed to master at williams/lmcp 2026-06-05 15:51:54 +00:00
8d8d8fac65 Add nash memory tools (nash_add/search/list/delete)
williams closed pull request williams/lmcp#1 2026-05-30 14:56:08 +00:00
fix: case-insensitive Bearer token parsing in auth header
williams deleted branch fix/case-insensitive-bearer-auth from williams/lmcp 2026-05-30 14:56:08 +00:00
williams created pull request marfrit/marfrit-packages#109 2026-05-30 14:52:55 +00:00
lmcp: bump to 1.2.2 — case-insensitive Bearer auth (marfrit/lmcp#25)
williams created repository williams/marfrit-packages 2026-05-30 14:51:22 +00:00
williams created pull request marfrit/lmcp#25 2026-05-30 12:55:40 +00:00
fix: case-insensitive Bearer token parsing in auth header
williams created pull request williams/lmcp#1 2026-05-30 12:55:24 +00:00
fix: case-insensitive Bearer token parsing in auth header