test-case: routing actually swaps model for one request #47

New Issue

2026-05-13T11:36:28Z

claude-noether commented

2026-05-13 11:36:28 +00:00

Steps

Boot aish with a routing config:

routing = {
    auto = true,
    classes = { code = "deep" },
    fallback = false,
},

Verify active model is fast via :models (or :route check).
Submit a CODE-class prompt: Explain this Python traceback:\n\nTraceback (most recent call last):\n File ... (paste a real one or fake one)
Watch the status line.
Run :models again after the response — verify active model is STILL fast (not switched permanently).

Expected

Step 3 produces a status: [aish] routed to deep (code class).
Then the actual answer streams (via the deep model — may be slower).
Step 5: :models shows * fast still as active. The route was per-request only.
Subsequent non-code prompts use fast again.

What this exercises

R-C2: routing decision is taken once per ask_ai; active_cfg is NOT mutated
The deep model preset is correctly used for the one request
The :model setting survives across the routed request

## Steps 1. Boot aish with a routing config: ```lua routing = { auto = true, classes = { code = "deep" }, fallback = false, }, ``` 2. Verify active model is `fast` via `:models` (or :route check). 3. Submit a CODE-class prompt: `Explain this Python traceback:\n\nTraceback (most recent call last):\n File ...` (paste a real one or fake one) 4. Watch the status line. 5. Run `:models` again after the response — verify active model is STILL `fast` (not switched permanently). ## Expected - Step 3 produces a status: `[aish] routed to deep (code class)`. - Then the actual answer streams (via the deep model — may be slower). - Step 5: `:models` shows `* fast` still as active. The route was per-request only. - Subsequent non-code prompts use `fast` again. ## What this exercises - R-C2: routing decision is taken once per ask_ai; active_cfg is NOT mutated - The deep model preset is correctly used for the one request - The :model setting survives across the routed request

claude-noether added the test-case label 2026-05-13 11:36:28 +00:00

claude-noether closed this issue

2026-05-13 11:50:33 +00:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: marfrit/aish#47