marfrit/aish
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

test-case: no routing/no summarize config = Phase 4 behavior intact #50

New Issue
Closed
opened 2026-05-13 11:36:29 +00:00 by claude-noether · 1 comment
claude-noether commented 2026-05-13 11:36:29 +00:00
Collaborator
Copy Link
Copy Source

Steps

  1. Boot aish with NO routing block and NO context.summarize_on_evict.
  2. Verify :route on / :route classes / :fallback on still WORK (config gets a fresh routing table).
  3. Have a long conversation that exceeds max_turns. Verify eviction happens silently (Phase 0 behavior); no [earlier summary] block in the system prompt.
  4. Verify :remember and :mcp list and Norris still all work end-to-end.

Expected

  • No regression from Phase 4. All meta commands respond. Long conversations evict turns silently.
  • The new Phase 5 meta cmds (:route, :fallback) can toggle config at runtime even when no routing block was present at startup.

What this exercises

  • All Phase 5 features are opt-in (R-N2 cost-safety + summarize_fn is nil when summarize_on_evict not set)
  • Runtime toggles via :route on create the routing table lazily
  • Phase 4 regression: memory + MCP + Norris all unchanged
## Steps 1. Boot aish with NO `routing` block and NO `context.summarize_on_evict`. 2. Verify `:route on` / `:route classes` / `:fallback on` still WORK (config gets a fresh routing table). 3. Have a long conversation that exceeds `max_turns`. Verify eviction happens silently (Phase 0 behavior); no `[earlier summary]` block in the system prompt. 4. Verify `:remember` and `:mcp list` and Norris still all work end-to-end. ## Expected - No regression from Phase 4. All meta commands respond. Long conversations evict turns silently. - The new Phase 5 meta cmds (:route, :fallback) can toggle config at runtime even when no `routing` block was present at startup. ## What this exercises - All Phase 5 features are opt-in (R-N2 cost-safety + summarize_fn is nil when summarize_on_evict not set) - Runtime toggles via :route on create the routing table lazily - Phase 4 regression: memory + MCP + Norris all unchanged
claude-noether added the test-case label 2026-05-13 11:36:29 +00:00
claude-noether commented 2026-05-13 11:50:34 +00:00
Author
Collaborator
Copy Link
Copy Source

PASS (autonomous run, 2026-05-13). Config with no routing block and no context.summarize_on_evict: :route classes reports (no classes configured); :route on creates the routing table lazily and reports auto-routing on; :fallback on reports cloud fallback on (target: cloud); no Lua errors or traceback. Phase 4 regression coverage intact. Closing.

**PASS** (autonomous run, 2026-05-13). Config with no `routing` block and no `context.summarize_on_evict`: `:route classes` reports `(no classes configured)`; `:route on` creates the routing table lazily and reports `auto-routing on`; `:fallback on` reports `cloud fallback on (target: cloud)`; no Lua errors or traceback. Phase 4 regression coverage intact. Closing.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
Behavior diverges from documented or expected operation.
 feature request
User-facing capability that aish does not yet have.
 recommendation
Concrete suggestion (config, deployment, integration) outside the strict feature/bug split.
 security
Affects credential/key/PII handling, sandboxing, or trust boundaries.
 test-case
User-runnable test scenario; comment to confirm pass or add `bug` tag on fail
No Label test-case
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
claude-noether (Claude (noether)) marfrit (Markus Fritsche)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: marfrit/aish#50
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?