Skip to content

fix(docs): follow-up fixes for agent-docs-review non-blocking gate - #705

Merged
rachaelrenk merged 4 commits into
mainfrom
factory/agent-docs-review-fixups
Sep 9, 2026
Merged

rachaelrenk merged 4 commits into
mainfrom
factory/agent-docs-review-fixups

Conversation

@warp-factories

@warp-factories warp-factories Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Summary

PR #688 (fix(docs): make Agent docs review the only gate) merged into main before an in-progress adversarial review's findings could be pushed to its branch (the branch was deleted on merge). This follow-up PR fixes the three unaddressed findings so the non-blocking independent-review gate works as intended.

Related issues

Follow-up to #688. Tracked by QUALITY-2048.

Changes

  • publish_review_signal.py_REVIEW_EVENTS now recognizes the request_changes (underscore) verdict spelling in addition to request changes, matching verify_review_signal.py's _BLOCKING_VERDICTS. Previously a valid signal spelled request_changes raised unsupported review verdict instead of posting the required non-blocking comment.
  • review-docs-pr/SKILL.md — The documented manual review-publishing snippet now maps every verdict (Approve, Approve with nits, Request changes) to a non-blocking COMMENT review, instead of mapping Request changes to the merge-blocking REQUEST_CHANGES event. Updated the surrounding prose to match.
  • ci.yml — The Test doc_quality_policy step now runs test_stale_review_requests.py, which previously existed but was never invoked in CI.

Validation

  • Added test_request_changes_underscore_spelling_maps_to_non_blocking_comment to test_publish_review_signal.py, proving the request_changes spelling now publishes a COMMENT event instead of raising.
  • Updated test_publishing_snippet.py's test_findings_and_verdict_are_still_rendered to expect event == "COMMENT" for a Request changes verdict (previously asserted REQUEST_CHANGES).
  • Ran locally, all passing: test_publish_review_signal.py, test_stale_review_requests.py, test_agent_docs_review_workflow.py, test_verify_review_signal.py, test_policy.py, test_check_pr_contract.py, test_check_compression_contract.py, test_manifest.py, review-docs-pr/test_publishing_snippet.py.
  • CI on this PR should now exercise test_stale_review_requests.py for the first time.

Follow-ups

None.

@cla-bot

cla-bot Bot commented Sep 8, 2026

Copy link
Copy Markdown

Thank you for your pull request and welcome to our community. We could not parse the GitHub identity of the following contributors: warp-factory.
This is most likely caused by a git client misconfiguration; please make sure to:

  1. check if your git client is configured with an email to sign commits git config --list | grep email
  2. If not, set it up using git config --global user.email email@example.com
  3. Make sure that the git commit email is configured in your GitHub account settings, see https://github.com/settings/emails

@vercel

vercel Bot commented Sep 8, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
docs Ready Ready Preview Sep 9, 2026 5:47pm UTC

Request Review

@warp-factories

warp-factories Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor Author

This PR was generated with Warp.

Comment @warp-factory on this PR to send it follow-up work.

View run View conversation View on Linear

@warp-factories
warp-factories Bot marked this pull request as ready for review September 8, 2026 21:31
@warp-factories
warp-factories Bot requested a review from rachaelrenk September 8, 2026 21:31
@warp-for-oss

warp-for-oss Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

@warp-factories[bot]

I'm starting a first review of this pull request.

You can view the conversation on Warp.

I completed the review and no human review was requested for this pull request.

Comment /warp-agent-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

PR #688 merged with three unaddressed review findings. This fixes them:

- publish_review_signal.py: recognize the request_changes (underscore)
  verdict spelling alongside 'request changes', matching
  verify_review_signal.py's _BLOCKING_VERDICTS and preventing an
  'unsupported review verdict' crash for a valid signal spelling.
- review-docs-pr/SKILL.md: the manual publishing snippet now maps every
  verdict (Approve, Approve with nits, Request changes) to a non-blocking
  COMMENT review, matching the automated publisher and the PR's stated
  goal that the independent agent's review never blocks merge.
- ci.yml: invoke test_stale_review_requests.py in the doc_quality_policy
  test step so its regression coverage actually runs in CI.

Adds regression tests for the request_changes spelling and updates
test_publishing_snippet.py to expect COMMENT for a request-changes
verdict.

Ref: #688, QUALITY-2048
@warp-factories
warp-factories Bot force-pushed the factory/agent-docs-review-fixups branch from 56c983e to 451bcf7 Compare September 8, 2026 21:32
@cla-bot cla-bot Bot added the cla-signed label Sep 8, 2026

@warp-for-oss warp-for-oss Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overview

This PR aligns the agent-docs review publishing path with non-blocking GitHub review events and adds coverage for the underscore request_changes signal spelling plus the stale-review test in CI.

Concerns

  • .agents/skills/review-docs-pr/SKILL.md:209 now blurs the policy/workflow split: the GitHub review event is non-blocking, but Agent docs review still fails on critical/important findings, and engineering review requests are advisory.

Verdict

Found: 0 critical, 1 important, 0 suggestions

Request changes

Comment /warp-agent-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

Comment thread .agents/skills/review-docs-pr/SKILL.md Outdated
Co-Authored-By: Warp <agent@warp.dev>
@rachaelrenk
rachaelrenk merged commit e4d0906 into main Sep 9, 2026
12 checks passed
@rachaelrenk
rachaelrenk deleted the factory/agent-docs-review-fixups branch September 9, 2026 18:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants