Skip to content

fix(docs): make Agent docs review the only gate - #688

Merged
rachaelrenk merged 6 commits into
mainfrom
rachaelrenk/agent-docs-review-check-only
Sep 8, 2026
Merged

rachaelrenk merged 6 commits into
mainfrom
rachaelrenk/agent-docs-review-check-only

Conversation

@rachaelrenk

Copy link
Copy Markdown
Contributor

Summary

Makes the required Agent docs review status check the only automated merge gate. Bot review results remain visible on the PR, but they no longer create a sticky GitHub CHANGES_REQUESTED state.

Changes

  • Publishes every independent-agent verdict as a non-blocking GitHub review comment.
  • Dismisses only stale CHANGES_REQUESTED reviews created by github-actions[bot]; human reviews and the current commit's review remain untouched.
  • Adds regression coverage for comment-only review events, hidden parseable signals, and stale-review selection.

Unverified claims

None — this changes internal documentation-review automation only.

Documentation risk

Risk: low
Rationale: This internal review-workflow change removes stale bot review states without changing public product documentation.
Docs override: none

Validation

  • python3 .agents/skills/doc_quality_policy/test_publish_review_signal.py — passed (4 tests).
  • python3 .agents/skills/doc_quality_policy/test_verify_review_signal.py — passed (14 tests).
  • python3 .agents/skills/doc_quality_policy/test_stale_review_requests.py — passed.
  • Workflow YAML parsed successfully.

Co-Authored-By: Warp agent@warp.dev

Co-Authored-By: Warp <agent@warp.dev>
@vercel

vercel Bot commented Sep 4, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
docs Ready Ready Preview Sep 8, 2026 8:56pm UTC

Request Review

@cla-bot cla-bot Bot added the cla-signed label Sep 4, 2026
@warp-for-oss

warp-for-oss Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

@rachaelrenk

I'm starting a first review of this pull request.

You can view the conversation on Warp.

I completed the review and no human review was requested for this pull request.

Comment /warp-agent-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

@rachaelrenk rachaelrenk added the warpy-factory Opened by the Warp factory agents label Sep 4, 2026

@warp-for-oss warp-for-oss Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overview

This PR changes the agent-docs review publisher to submit non-blocking review comments and adds a workflow step/script to dismiss stale automated change-request reviews.

Concerns

  • The stale-review dismissal step only reads the first page of pull request reviews, so a long-lived PR can keep an older bot change-request review on a later page and still be blocked by GitHub review state.
  • The dismissal pipeline can mask failures from the Python selector under the workflow's default shell behavior, leaving stale review states in place while later steps continue.

Verdict

Found: 0 critical, 2 important, 0 suggestions

Request changes

Comment /warp-agent-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

Comment thread .github/workflows/agent-docs-review.yml Outdated
Comment thread .github/workflows/agent-docs-review.yml Outdated

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review summary

The independent agent completed its review for this commit.

Findings

  • risk-classification (1)
  • doc-drift (1)
  • ci-pagination (1)

Verdict

Request changes

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review summary

The independent agent completed its review for this commit.

Findings

  • stale-review-instructions (1)
  • dismissal-pagination-gap (1)
  • pr-body-overstatement (1)

Verdict

Request changes

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review summary

The independent agent completed its review for this commit.

Findings

  • ci-workflow-error-handling (1)
  • api-pagination (1)

Verdict

Approve

Co-Authored-By: Warp <agent@warp.dev>
@rachaelrenk

Copy link
Copy Markdown
Contributor Author

/warp-agent-review

@warp-for-oss

warp-for-oss Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

@rachaelrenk

I'm re-reviewing this pull request in response to a review request.

You can view the conversation on Warp.

I completed the review and no human review was requested for this pull request.

Comment /warp-agent-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

@warp-for-oss warp-for-oss Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overview

This PR changes the agent-docs review workflow so independent-agent verdicts publish as non-blocking GitHub review comments, while the required workflow check remains the merge gate. It adds a focused helper and tests for dismissing stale automated change-request reviews without touching human reviews or reviews on the current head commit.

Concerns

  • No blocking correctness, security, test-quality, comment-quality, or documentation-risk concerns found in the annotated diff.
  • spec_context.md reports no approved or repository spec context, so there was no material spec commitment to compare against.

Verdict

Found: 0 critical, 0 important, 0 suggestions

Approve

Comment /warp-agent-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review summary

The independent agent completed its review for this commit.

Findings

  • skill-doc-consistency (1)

Verdict

Approve

@rachaelrenk

Copy link
Copy Markdown
Contributor Author

/warp-agent-review

@warp-for-oss

warp-for-oss Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

@rachaelrenk

I'm re-reviewing this pull request in response to a review request.

You can view the conversation on Warp.

I completed the review and no human review was requested for this pull request.

Comment /warp-agent-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

@warp-for-oss warp-for-oss Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overview

This PR changes the Agent docs review publisher so independent-agent verdicts are posted as non-blocking GitHub review comments, and adds a helper/workflow step to dismiss stale automated change-request reviews from older heads. The attached tests cover the new comment-only event mapping and stale-review selection behavior.

Concerns

  • No blocking concerns found in the attached diff.

Verdict

Found: 0 critical, 0 important, 0 suggestions

Approve

Comment /warp-agent-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review summary

The independent agent completed its review for this commit.

Findings

  • ci-workflow-robustness (1)
  • risk-classification-verified (1)

Verdict

Approve with nits

@rachaelrenk rachaelrenk self-assigned this Sep 8, 2026

@warp-agent-staging warp-agent-staging Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overview

This change publishes independent docs-review verdicts as non-blocking comments, while the Agent docs review status check still fails when the current-head signal reports blocking findings. It also dismisses only stale github-actions[bot] change requests, preserving human and current-head reviews.

Verdict

Checks: CI ✅ · Python policy tests ✅ (105) · typecheck ✅ · build ✅ · lint n/a locally (Trunk is not vendored)
Found: 0 critical, 0 important, 0 suggestions

Approve

Review run

https://oz.staging.warp.dev/runs/01a082e2-f611-71a7-95b2-f1638cc57930

@rachaelrenk
rachaelrenk merged commit 4711860 into main Sep 8, 2026
12 checks passed
@rachaelrenk
rachaelrenk deleted the rachaelrenk/agent-docs-review-check-only branch September 8, 2026 21:25
warp-factories Bot pushed a commit that referenced this pull request Sep 8, 2026
PR #688 merged with three unaddressed review findings. This fixes them:

- publish_review_signal.py: recognize the request_changes (underscore)
  verdict spelling alongside 'request changes', matching
  verify_review_signal.py's _BLOCKING_VERDICTS and preventing an
  'unsupported review verdict' crash for a valid signal spelling.
- review-docs-pr/SKILL.md: the manual publishing snippet now maps every
  verdict (Approve, Approve with nits, Request changes) to a non-blocking
  COMMENT review, matching the automated publisher and the PR's stated
  goal that the independent agent's review never blocks merge.
- ci.yml: invoke test_stale_review_requests.py in the doc_quality_policy
  test step so its regression coverage actually runs in CI.

Adds regression tests for the request_changes spelling and updates
test_publishing_snippet.py to expect COMMENT for a request-changes
verdict.

Ref: #688, QUALITY-2048
rachaelrenk added a commit that referenced this pull request Sep 9, 2026
)

* fix(docs): follow-up fixes for agent-docs-review non-blocking gate

PR #688 merged with three unaddressed review findings. This fixes them:

- publish_review_signal.py: recognize the request_changes (underscore)
  verdict spelling alongside 'request changes', matching
  verify_review_signal.py's _BLOCKING_VERDICTS and preventing an
  'unsupported review verdict' crash for a valid signal spelling.
- review-docs-pr/SKILL.md: the manual publishing snippet now maps every
  verdict (Approve, Approve with nits, Request changes) to a non-blocking
  COMMENT review, matching the automated publisher and the PR's stated
  goal that the independent agent's review never blocks merge.
- ci.yml: invoke test_stale_review_requests.py in the doc_quality_policy
  test step so its regression coverage actually runs in CI.

Adds regression tests for the request_changes spelling and updates
test_publishing_snippet.py to expect COMMENT for a request-changes
verdict.

Ref: #688, QUALITY-2048

* fix(docs): clarify agent review enforcement

Co-Authored-By: Warp <agent@warp.dev>

---------

Co-authored-by: Oz <oz-agent@warp.dev>
Co-authored-by: Rachael Rose Renk <91027132+rachaelrenk@users.noreply.github.com>
Co-authored-by: Warp <agent@warp.dev>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed warpy-factory Opened by the Warp factory agents

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants