Files
kandev/docs/plans/executor-model-mismatch-fallback/task-04-model-mismatch-evidence.md
T
2026-08-24 11:09:03 +00:00

78 lines
2.9 KiB
Markdown

---
id: "04-model-mismatch-evidence"
title: "Prove model-mismatch recovery"
status: done
wave: 4
depends_on: ["03-remove-host-model-gates"]
plan: "plan.md"
spec: "../../specs/agents/requirements/no-silent-model-fallback.md"
---
# Task 04: Prove model-mismatch recovery
## Acceptance
- Desktop E2E proves profile selection, task continuation, one warning, and warning persistence after reload.
- Mobile E2E proves the same outcome through touch input without horizontal overflow.
- Public documentation explains executor authority, optional configuration copying, and the unchanged saved profile model.
## TDD scenarios
1. RED: Update the existing profile-picker E2E to require a selectable host mismatch.
2. RED: Add a task-launch scenario with an executor catalog that omits the requested model.
3. RED: Add reload and mobile scenarios for the persisted warning.
4. GREEN: Complete missing fixtures and selectors without weakening the runtime assertions.
5. GREEN: Update the public agent-profile and executor documentation.
6. REFACTOR: Share desktop and mobile model-mismatch setup helpers.
## Verification
- `cd apps/web && pnpm e2e:run tests/settings/no-silent-model-fallback.spec.ts tests/session/model-mismatch-warning.spec.ts`
- `cd apps/web && pnpm e2e:run --project mobile-chrome --no-build tests/settings/mobile-no-silent-model-fallback.spec.ts tests/session/mobile-model-mismatch-warning.spec.ts`
- `node --test scripts/validate-public-docs.test.mjs`
- `node scripts/validate-public-docs.mjs`
- `git diff --check`
## Files likely touched
- `apps/web/e2e/tests/settings/no-silent-model-fallback.spec.ts`
- `apps/web/e2e/tests/settings/mobile-no-silent-model-fallback.spec.ts`
- `apps/web/e2e/tests/session/model-mismatch-warning.spec.ts`
- `apps/web/e2e/tests/session/mobile-model-mismatch-warning.spec.ts`
- `apps/web/e2e/tests/session/model-mismatch-warning-helpers.ts`
- `apps/web/e2e/helpers/api-client.ts`
- `docs/public/agents-and-profiles.md`
- `docs/public/executors.md`
## Dependencies
- Task 03 completes runtime, persistence, and frontend behavior.
## Parallelism
Sequential after Task 03.
This task validates the complete user flow.
## Inputs
- The completed model-decision and warning flow.
- Existing no-silent-model-fallback E2E files.
- The mock agent model catalog.
- The public executor documentation.
## Output contract
Report exact E2E commands, reload evidence, mobile geometry, public pages, failures, and final package status.
## Risks
- The host and executor catalogs need a deterministic mismatch fixture.
- Worker-scoped profiles and tasks require cleanup after each scenario.
- A warning visible before reload does not prove persistence.
## Results
Desktop and mobile E2E proved task continuation, one warning, saved-profile
preservation, and warning visibility after reload without horizontal overflow.
Public documentation validation passed with 61 tests and 41 published pages.