Skip to content

fix: prove native conditioning before preserving reasoning markers - #974

Draft
bradhilton wants to merge 1 commit into
mainfrom
hayek/native-render-contract-20260925
Draft

bradhilton wants to merge 1 commit into
mainfrom
hayek/native-render-contract-20260925

Conversation

@bradhilton

@bradhilton bradhilton commented Sep 25, 2026 •

Copy link
Copy Markdown
Collaborator

Agent: Hayek

A template-specific exception cannot establish whether literal reasoning markers belong to sampled assistant output. Replace it with a behavior check: render copies and verify the full native prefix before preserving that content with thinking explicitly disabled.

Missing evidence or unsupported rendering declines the repair. This does not reinterpret SFT or reasoning data, and sampled stop-token handling in #973 is separate.

Validation: 536 CPU checks and six public Qwen BPE cases passed, along with retained CI. The proof has measurable cost: ordinary thinking-off cases add 12–37.5%, and a 32-turn all-literal case takes 2.52 times as long. This is a correctness change, not a performance improvement.

@bradhilton bradhilton changed the title Prove native conditioning before preserving literal reasoning markers fix: prove native conditioning before preserving reasoning markers Sep 30, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant