Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
c660ea7
perf(ui-loop): skip the redundant baseline mxbuild, wait on page stat…
claude Oct 7, 2026
85afba1
perf(ui-loop): reload a stale app, settle journeys, worst-first look …
claude Oct 7, 2026
a908b4e
test: journey fixtures copy settle.js with the engine
claude Oct 7, 2026
6444992
perf(ui-loop): test-stack-up recognises mxcli run --local; restart bu…
claude Oct 7, 2026
94532e4
test(stack-up-local): resolve Python via portable.sh require_py
claude Oct 7, 2026
ff83fc8
test(stack-up-local): backdate the handshake so a same-tick edit stil…
claude Oct 7, 2026
00eb953
fix(sync): sync-project.sh no longer exits 1 silently before its bin/…
MendixMau Oct 7, 2026
bf761db
Merge master into perf/stack-up-local-loop
claude Oct 8, 2026
adc2203
fix(init): local by default, park the Dev Container mxcli writes
claude Oct 8, 2026
df42f3b
docs(lint): process/lint-backlog.md β€” the lint rollout plan, on disk
claude Oct 8, 2026
1cd17d0
new(lint): gate writes a per-run ledger; lint-trend.sh reads it
claude Oct 8, 2026
5971577
skills: promote e2e-locators-that-lie (four Playwright harness defect…
MendixMau Oct 8, 2026
c3cd9af
skills: promote unhappy-path-testing (requirement-cited unhappy-path …
MendixMau Oct 8, 2026
afeba3c
docs(testing-shape): test --local shares the deploy dir with run --lo…
claude Oct 8, 2026
f5135df
merge perf/stack-up-local-loop into integration/2026-10-08
claude Oct 8, 2026
03ad43b
merge fix/no-devcontainer into integration/2026-10-08
claude Oct 8, 2026
560473f
merge docs/lint-backlog into integration/2026-10-08
claude Oct 8, 2026
268f231
merge feat/lint-ledger into integration/2026-10-08
claude Oct 8, 2026
237228a
merge fix/sync-project-dup-heading-exit into integration/2026-10-08
claude Oct 8, 2026
61e5bbc
merge feat/e2e-locators-that-lie into integration/2026-10-08
claude Oct 8, 2026
115e44f
merge feat/unhappy-path-testing into integration/2026-10-08
claude Oct 8, 2026
bec907c
fix(obligations): LOOK staleness picks the newest VALID AT stamp (#155)
claude Oct 8, 2026
32dab3c
docs(lint-backlog): batch 4 from Mendix quality-source review
claude Oct 8, 2026
ab346f7
fix(lint): CONV020 default scope "*" and page actions count as feedba…
claude Oct 8, 2026
5bac09c
merge docs/testing-shape-local-deploy into integration/2026-10-08
claude Oct 8, 2026
3f568e0
merge fix/obligation-valid-at-picker into integration/2026-10-08
claude Oct 8, 2026
19c903f
merge docs/lint-backlog-batch4 into integration/2026-10-08
claude Oct 8, 2026
847bf10
merge fix/conv020-modules-feedback into integration/2026-10-08
claude Oct 8, 2026
6c84fd2
fix(e2e): journey-runner rung 2 runs for mustNotFire-only spans (#150)
claude Oct 8, 2026
e6e5ac3
merge fix/journey-rung2-mustnotfire into integration/2026-10-08
claude Oct 8, 2026
9dbe0c2
fix(gates): surface status, realpath source root, JOURNEY_DIR token (…
claude Oct 8, 2026
69806fb
merge fix/gate-surface-realpath-journeydir into integration/2026-10-08
claude Oct 8, 2026
d3f1985
test(sync): neutral wording for the field evidence in the dup-heading…
claude Oct 8, 2026
5f7d293
Merge fix/sync-project-dup-heading-exit (neutral wording) into integr…
claude Oct 8, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,21 @@ Sections dated before 2026-09-19 predate the cycle and stay as they are.

## Unreleased

- perf(ui-loop): **`test-stack-up.sh` recognises a live `mxcli run --local` as this project's app, and `--restart` no longer builds twice.** The script read only Docker labels, so an app started with `./mxcli run --local --watch` (mxcli's own ~20s page loop) was found by port scan, published as `APP_OWNERSHIP=unverified`, and refused by the e2e harness unless `ALLOW_UNVERIFIED_APP=1`. It now reads mxcli's `.mxcli/run-local.json` handshake (v0.24+; beside the `.mpr` or the `-p` path on a two-tree checkout), checks its pid is alive, and publishes `verified` with a new `APP_SOURCE=run-local` line in `stack.env` (`docker` / `scan` otherwise). A model edited after boot reads as applied under `--watch` and as STALE without it β€” the script never restarts a loop it did not start. Docker bring-up and restart now wait on `mxcli docker run --wait` instead of a 240s poll loop, and still prove HTTP; `--restart` used to fall through into the bring-up block and run `docker run` a second time. New fixture `tests/wave2/test-stack-up-local.sh` over a redacted capture of the handshake. Field run 2026-10-07, existing app: same app, same port, `unverified` β†’ `verified`; a touched model read `watch`; stopping the loop removed the handshake and the script fell back. β€” MendixMau
- fix(init): **local by default, no Dev Container.** `init-project.sh` now parks the `.devcontainer/` that `mxcli new`/`init` always writes under `.mxtk-backup/` (keep it with `MXTK_KEEP_DEVCONTAINER=1`), and the README says "say no" to VS Code's reopen prompt. Field incident 2026-10-08: a first-time user followed the docs and landed in the container with "claude: command not found" (the template installs `claude` to `~/.local/bin` and never puts it on PATH) and a fresh login prompt. Local use was always the intent. β€” MendixMau
- docs(lint): **Mendix quality-source review: 19 new lint-backlog rows (Batch 4) plus seven skill additions.** Recommender, QSM/AQM, ATS, Menditect and docs.mendix.com mapped against shipped rules; indexes, scheduled events, Atlas 4 tokens, accessibility floor, workflow targeting, test isolation and rollback semantics added to their skills; record in `process/quality-sources-review-2026-10-08.md`; no rule probed on a model yet β€” MendixMau
- docs(lint): **`process/lint-backlog.md` β€” the lint rollout plan, on disk.** Twelve rule candidates mined from `skills/` with the evidence each rests on, the catalog field each needs, and five rollout rules (two or three rules per PR, ship as warning, one field run before merge, promote after two clean projects, blind rules say so). Plus what is not lintable and lives in a skill (theme, logging, scheduled events) and four brain contradictions to settle first. Until today this plan existed only in chat. β€” MendixMau
- new(lint): **the lint gate keeps a ledger, so a rule's history is readable.** `project-bin/lint-gate.sh` appends one row per rule per run to `.claude/loop/lint-ledger.tsv` (ts, verdict, rule, count, severity, blind β€” plus a `_run` row with the total), and new `project-bin/lint-trend.sh` prints per rule: runs fired in, first/last count with dates, best/worst, blind runs, and up/down/flat (`--rule <id>` for one rule's series, `--runs` for the run rows). Until now the only per-rule history was `lint-baseline.json` in git, which records the count that was accepted, not what each run saw β€” so "did the rule we shipped catch anything, and did it go down" had no answer. This is the measurement the lint rollout plan's "promote after two clean projects" step depends on. Probed on the gate's own parser with a crafted lint result (3 findings, one blind rule): ledger rows and trend output as expected; `lint-last.json` and the ratchet verdict unchanged. Field run on a real model still owed (laptop). β€” MendixMau
- learn(test): **`skills/e2e-locators-that-lie.md`** β€” four Playwright harness defects that report a defect in the app: a widget name is unique per page not per DOM (hidden tab pane first, so `.first()` drives or asserts the wrong node), `click({force:true})` on a Mendix tab is swallowed and never throws (so force-then-plain fallback is dead), a grid re-renders on the response not the click (single-read text assertions race), and a fixture literal the reset script writes measures only the reset. Measured 2026-09-17 on a user-group administration module; routed for test/review at Stages 5–6 (diagnose), pointer from `e2e-harness-base.md`. The shipped `project-tests/e2e/journey-runner.js` does not yet apply rules 1–3; the skill says so. β€” MendixMau
- learn(skills): **`unhappy-path-testing.md` β€” requirement-cited unhappy-path e2e.** Every case cites a requirement (BRD rule, entity doc comment, `not null` error, `Visible:` expression, grant) before it runs; results are PASS / GAP / UNSPECIFIED, and UNSPECIFIED is re-scored against seven house rules (whitespace-as-required, silent truncation, no empty-state text, …) as GAP-HOUSE so a silent requirement cannot hide a user-visible defect. Measured on a warehouse-management demo project, 2026-09-24/25: 45 cases over 5 modules, five overnight runs 16 β†’ 25 of 45 PASS (run 2's 17 GAPs were 10 instrument faults from one deep link), fix loop to 27/45 PASS, 5 GAP, 13 UNSPECIFIED, every GAP an open product Decision. Routed `test,review` at stages 5–6 (`verify`, ondemand) and pointed at from `testing-shape.md`'s owner table. β€” MendixMau
- fix(testing-shape): **`mxcli test --local` shares the deploy directory with `run --local`, so a warm app does not keep serving.** The skill said separate ports and database meant a warm `run --local` loop survives a test run; mxbuild writes `<app dir>/deployment` for both, so a building test run breaks the live app (200 with empty bodies, NoClassDefFoundError). Now says to restart `run --local` after `test --local` and that `--attach` hot-applies into the live app. Field run 2026-10-07, existing app (#230) β€” MendixMau
- fix(obligations): **LOOK staleness reads the newest `VALID AT` stamp, anywhere in the report.** Both pickers took the first stamp inside the first 8000 bytes, so a review file with dated per-build addenda went false-STALE; now `tail -1` over the whole file. Field run 2026-09-26, requirements-driven build (#155) β€” MendixMau
- fix(lint): **CONV020 works out of the box and counts page navigation as feedback.** `PROJECT_MODULES` now defaults to `"*"` (every module the lint run includes, minus `.claude/lint-vendor-modules.txt`) instead of an empty tuple that made a fresh install inert; ShowPage/ClosePage/ShowHomePage actions count as user feedback (presence only; refresh-in-client is not exposed by mxcli, noted in the rule header). `lint-gate.sh --update-baseline` no longer baselines `_rule` (self-reported blindness) findings. Starlark fixture not run: no mxcli binary or rule runner in this repo; installer fixture `test-lint-delivery.sh` green (#229, #245) β€” MendixMau
- fix(e2e): **journey-runner rung 2 now runs for a negative-only span claim.** `spans: { ordered: [], mustNotFire: [...] }` was skipped silently because the rung required a non-empty `ordered`; it now runs when either list is non-empty (sequence assert only when `ordered` is non-empty). Zero captured spans still reports INVALID (a vacuous negative is not proof). Verified by `node --check` and a gate-condition probe, no live Jaeger run (#150) β€” MendixMau
- fix(gates): **Stage 6 Surface agrees with the gate, source-sufficiency title resolves `.`, journeys artifact row honours `JOURNEY_DIR`.** `test_surface_hit()` is now the one test behind both check_stage_6 and the Surface column (#233); the report title takes the realpath basename (#234); the manifest accepts a `${JOURNEY_DIR}` token resolved like verify-module.sh (#235). Field run 2026-10-08, existing app β€” MendixMau
- perf(routing): **CLAUDE.local.md routing carries triggers only.** The `baseline` view (the copy loaded into every session of every project) now cuts each row's "when" cell at its first " β€” " and replaces the three-paragraph preamble with two lines pointing at `ROUTING.md` for the full text; `readme-baseline` (README, runbook) is unchanged. Fresh scaffold: CLAUDE.local.md 17.5 KB β†’ 11.7 KB (βˆ’33%). Field run 2026-10-07 (existing app, one main session per run, 2 runs per side, an entity + 2 microflows + 2 pages): 10/10 steps applied each side, new mx errors 5 vs 5 (the same CE2421 page-binding slip in both), cost $1.39 vs $1.38; the slim lanes opened the MDL pre-flight skill as often or more. Also drops two stray merge-artifact lines from this section. β€” MendixMau
- fix(sync): **`sync-project.sh` no longer exits 1, silently, before its `bin/` and `tests/e2e/` refresh.** The CLAUDE.md duplicate-routing check (section 3) looked up the "mxcli-project-toolkit Integration" heading with an unguarded `grep | head | cut` under `set -euo pipefail`; when CLAUDE.md cites `skills/query-the-model.md` or `skills/learned-mdl-preflight.md` without that heading, which is every CLAUDE.md mxcli init v0.25 writes, grep's exit 1 ended the script with no message. Every step after it never ran: the crash-net refresh, the tests/e2e install and the lint-rule restore. Introduced by 9a0350b (2026-09-18). Now `|| true`, and `ledger_row_prefix` gets the same guard. Field: three consuming projects of one organisation (2026-10-07): the dry run went from exit 1 after "Would rewrite: CLAUDE.md" to exit 0 listing 7 and 8 skipped `bin/` refreshes. New fixture `tests/wave2/test-sync-dup-heading-exit.sh` (4 of 6 fail on the pre-fix script). β€” MendixMau (field run, existing apps)
perf/faster-ui-loop
- perf(ui-loop): **fewer mxbuilds, no fixed sleeps, legible screenshots.** Field run 2026-10-07 (a requirements-driven build): `exec.sh` was 22% of tool time at two mxbuilds per exec, journeys and page waits slept a fixed time, and screenshots were 11.5% of re-read tokens. `exec.sh` now skips the pre-flight baseline mxbuild when the model is byte-identical to its last *clean* pass: the verification stamp gains an `errors:` field (`model-stamp.sh check --clean` accepts only `errors: 0`, so a delta-gate pass over pre-existing errors never counts; `SKIP_BASELINE=0` is unchanged). New `tests/e2e/settle.js` waits for the page's own state (no visible Mendix progress/loading indicator, DOM size stable) instead of a fixed time; `journey-runner.js` uses it after each action (an explicit `settleMs` still wins) and `page-audit.js` per page. Probed in a real browser: on a page that loads in 1.8 s the old 1200 ms sleep and networkidle+600 both captured it half-loaded, settle waited for it; on a fast page settle took 775 ms vs 1200. `SETTLE_MODE=fixed` restores the old waits for an A/B run. `page-audit.js` also saves a viewport shot `page-audit-<Page>.top.png` beside the full-page one, and `ui-loop.md` says to look at viewport shots: a tall full-page shot reaches the model at ~1024 px high, text unreadable. `shrink-image-read.sh` now works off macOS (ImageMagick or Pillow, python when jq is absent; it was a silent no-op without `sips`). β€” MendixMau
- perf(ui-loop): **a stale app reloads instead of restarting, journeys stop sleeping, worst pages are looked at first.** Field run 2026-10-07, existing app. `test-stack-up.sh` records which model the running app was built from (`.claude/loop/served-model`); when the model has changed since, it hot-reloads with `mxcli docker reload` (adding `--skip-check` when the exec.sh gate already passed this model) and restarts only if that fails: 93 s instead of 179 s. `ui-loop.md` and the script header carry the measured table and point at `mxcli run --local --watch` as the fast loop (~18 s per page change). `journey-runner.js` waits on page state after a combobox action instead of fixed pauses, and a combobox step now opens the widget it names: it used to open the page's first combobox, so on a form with three every step but the first failed. `page-audit.js` clicks the first copy of a nav item a user could actually click, not just the first match: with the sidebar collapsed, every in-nav page faulted while the same item sat in the top menu bar. It also writes `page-audit-look-order.txt`, all pages worst first (`module-review.md` Β§4a: order, not selection, every page is still looked at). `design-audit.js` drops its fixed 1.2 s wait. Same 7-step journey on the same app: 56 s with `SETTLE_MODE=fixed`, 24 s with settle, 11/11 pass both ways, 3 runs each. β€” MendixMau

Expand Down
17 changes: 10 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -111,13 +111,14 @@ network hop with path translation on every file argument. The toolkit does none
Git Bash runs where Studio Pro, `mxcli` and your model already live, and ships with Git for
Windows. `doctor.sh` detects WSL and warns.

**This is about the shell you type in, not about Docker.** Docker Desktop on Windows runs its
engine on a WSL2 backend, and VS Code will offer to "install Docker on WSL" the first time you
reopen an `mxcli new` project in its Dev Container β€” say yes. That is the `devcontainer` lane
(`CONVERSION-RUNBOOK.md` β†’ *Where you run this*), headless and fully supported; `doctor.sh`
detects it and records it. The warning above applies only when you run the toolkit's scripts
*yourself* from a WSL prompt against a Studio Pro on the Windows side. Real question, 2026-09-07:
"the toolkit says not WSL, but `mxcli new`'s Dev Container wants Docker on WSL β€” yes or no?" Yes.
**This is about the shell you type in, not about Docker.** `mxcli new` writes a `.devcontainer/`
and VS Code then offers to "Reopen in Container" β€” **say no, work locally.** The container is a
second machine (no `claude` login, no dotfiles, a fragile install step), and the toolkit's path
is plain local use: `bin/init-project.sh` parks that folder under `.mxtk-backup/` so the prompt
stops. If you already clicked yes: F1 β†’ "Dev Containers: Reopen Folder Locally", nothing is lost.
Real incident, 2026-10-08: a first-time user landed in the container with "claude: command not
found" and a fresh login prompt. The `devcontainer` lane in `CONVERSION-RUNBOOK.md` stays
supported for those who want it (`MXTK_KEEP_DEVCONTAINER=1`), it is just not the default.

**The lanes mix freely on one project.** Do the headless stages in the Dev Container, then open
the same `.mpr` in Studio Pro from Git Bash for the steps MDL cannot express and UI polish, and go back.
Expand Down Expand Up @@ -649,6 +650,7 @@ Every mxcli project has a `.ai-context/skills/` directory (bundled by `mxcli ini
| Writing DB assertion tests that cross-check UI state against the database | `skills/learned-db-assertions.md` |
| Establishing the data and identities a journey run needs β€” BEFORE it runs. Derive and measure with project-bin/fixture-manifest.sh first; interview only the residue, and never seed from inside the harness | `skills/fixture-seeding.md` |
| Proving a module's user journey end-to-end β€” the deep form of step 3 PROVE; use whenever an instrument reports green and you cannot say what would have made it red | `skills/journey-proof.md` |
| Writing or running e2e cases beyond the happy journeys (blank/whitespace required fields, over-length, duplicates, cancel, double submit, wrong state, wrong role, backend down, stale write, empty search) β€” every case cites a requirement first, UNSPECIFIED is re-scored against house rules, GAP counts carry the denominator; runs after journey-proof and before monkey-test | `skills/unhappy-path-testing.md` |
| Running the fuzz/crash net on a module whose journeys are already green β€” and reading the result, which is NOT evidence the module works | `skills/monkey-test.md` |
| UX audit and screenshot-loop discipline | `skills/learned-skill-ux-audit.md` |
| Tracking scope delta between the BRD and the built state | `skills/learned-skill-scope-delta.md` |
Expand All @@ -674,6 +676,7 @@ Every mxcli project has a `.ai-context/skills/` directory (bundled by `mxcli ini
| Task | Skill to load |
|---|---|
| Reading a whole class of tool defects (a retest, a new mxcli release, an audit) β€” for one CE code or symptom use bin/bug-lookup.sh instead; the ledger is 32k words | `bug-logs/mxcli-bugs.md` |
| An e2e rung reports a UI defect (widget never appeared, click did nothing, screen contradicts the data, fixture count wrong) β€” check the locator before blaming the app: :visible, click order, poll, derived fixtures | `skills/e2e-locators-that-lie.md` |
| Any refused, denied or blocked command β€” BEFORE rewriting a permission rule and before telling the user a tool is blocked. A rule matches the START of the command line, so an allowlisted tool prefixed with cd matches nothing | `skills/agent-permission-friction.md` |
| Studio Pro will not load the project, or the .mpr looks gutted β€” recover before relaunching SP, never git checkout | `skills/mpr-corruption-and-sp-load-errors.md` |
| Preparing an mxcli/Studio Pro bug for submission β€” scope pinning, read-back-vs-write-path verification, gate-sensitivity negative controls, severity scoping, before it's called filable | `skills/bug-submission-checklist.md` |
Expand Down
2 changes: 2 additions & 0 deletions ROUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -211,6 +211,7 @@ picks the row up. That is the whole procedure β€” there is no second list to rem
| Writing DB assertion tests that cross-check UI state against the database | `skills/learned-db-assertions.md` | test | 6 | ondemand |
| Establishing the data and identities a journey run needs β€” BEFORE it runs. Derive and measure with project-bin/fixture-manifest.sh first; interview only the residue, and never seed from inside the harness | `skills/fixture-seeding.md` | test,review | 5,6 | ondemand |
| Proving a module's user journey end-to-end β€” the deep form of step 3 PROVE; use whenever an instrument reports green and you cannot say what would have made it red | `skills/journey-proof.md` | test,review | 5,6 | ondemand |
| Writing or running e2e cases beyond the happy journeys (blank/whitespace required fields, over-length, duplicates, cancel, double submit, wrong state, wrong role, backend down, stale write, empty search) β€” every case cites a requirement first, UNSPECIFIED is re-scored against house rules, GAP counts carry the denominator; runs after journey-proof and before monkey-test | `skills/unhappy-path-testing.md` | test,review | 5,6 | ondemand |
| Running the fuzz/crash net on a module whose journeys are already green β€” and reading the result, which is NOT evidence the module works | `skills/monkey-test.md` | test,review | 5,6 | ondemand |
| UX audit and screenshot-loop discipline | `skills/learned-skill-ux-audit.md` | review | 6 | ondemand |
| Tracking scope delta between the BRD and the built state | `skills/learned-skill-scope-delta.md` | review | 6 | ondemand |
Expand All @@ -237,6 +238,7 @@ picks the row up. That is the whole procedure β€” there is no second list to rem
| Always relevant for | Load this | Agent(s) | Stage(s) | Tier |
|---|---|---|---|---|
| Reading a whole class of tool defects (a retest, a new mxcli release, an audit) β€” for one CE code or symptom use bin/bug-lookup.sh instead; the ledger is 32k words | `bug-logs/mxcli-bugs.md` | mdl,gate | 5,6 | ondemand |
| An e2e rung reports a UI defect (widget never appeared, click did nothing, screen contradicts the data, fixture count wrong) β€” check the locator before blaming the app: :visible, click order, poll, derived fixtures | `skills/e2e-locators-that-lie.md` | test,review | 5,6 | ondemand |
| Any time an exit code, a tool's output or a subagent's report is about to become a stated finding β€” verify before you conclude | `skills/tool-output-is-not-ground-truth.md` | all | - | baseline |
| Any refused, denied or blocked command β€” BEFORE rewriting a permission rule and before telling the user a tool is blocked. A rule matches the START of the command line, so an allowlisted tool prefixed with cd matches nothing | `skills/agent-permission-friction.md` | all | - | ondemand |
| Studio Pro will not load the project, or the .mpr looks gutted β€” recover before relaunching SP, never git checkout | `skills/mpr-corruption-and-sp-load-errors.md` | mdl,gate | - | ondemand |
Expand Down
Loading
Loading