Initial commit: Boltzmann LLM proxy with compression + classifier middleware

- llm-proxy.py v4: aggregator with classify/compress endpoints, gemma4 backend
- classifier-server.py: Llama 3.2 1B query complexity classifier
- compress-server.py: token-budget compression middleware
- start-proxy.sh / start.sh: launcher scripts
This commit is contained in:
Markus Fritsche
2026-06-15 15:12:25 +02:00
commit c121428c58
8 changed files with 712 additions and 0 deletions
Executable
+6
View File
@@ -0,0 +1,6 @@
#!/bin/bash
pkill -f llm-proxy.py 2>/dev/null
sleep 1
cd /home/mfritsche/npu
nohup python3 llm-proxy.py > proxy.log 2>&1 &
echo "proxy started PID $!"