ci: gate concurrent retention and logging throughput - #422
Conversation
…raphql-quota-exhausti' into ci/391-20261003-ci-add-concurrency-and-log-throughput-scenarios-to-the-compa
…raphql-quota-exhausti' into ci/391-20261003-ci-add-concurrency-and-log-throughput-scenarios-to-the-compa # Conflicts: # docs/performance.md # scripts/benchmark_runtime.py
…raphql-quota-exhausti' into ci/391-20261003-ci-add-concurrency-and-log-throughput-scenarios-to-the-compa
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The comparative benchmark now gates concurrent retention and sustained logging. Twelve synchronized processes share a warmed cache, and persistent/ephemeral logging emits 3,000 records per sample. Reports use schema v2 with explicit latency, throughput, ratio, and budget units; the retained CI artifact remains compatible by filename.
Validation: stress-gate tests across all four profiles, including missing/nonfinite/regressed metrics; a 31-sample local run passed. macOS calibration: concurrent/serial p95 2.42x; ephemeral logging p95 6.20 us/record; persistent logging p95 14.15 us/record. Hosted profile calibration runs with this PR and must pass before merge.
Train: follows #421. Fixes #391.
Hosted calibration from run 37054920383: concurrency ratios macOS 4.49x, Windows 2.99x, WSL 4.25x; persistent logging p95 46.42, 49.03, and 22.90 us/record respectively. The macOS logging cap is calibrated to 60 us/record after its initial 40 us estimate failed. Windows and WSL checks passed; all three retained reports pass the calibrated checker. Unix and final-head hosted checks remain pending.