Conversation
The CodSpeed simulation counts the instructions, so it misses what only shows in the time: the cache and branch prediction effects. This adds a CircleCI job running the evmone and precompiles benchmarks with the CodSpeed walltime instrument on a dedicated VM, which measures stably enough without CodSpeed's own bare-metal runners.
Merging this PR will improve performance by 2.71%
|
| Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|
| ⚡ | baseline/analyse/main/sha1_shifts |
11.5 µs | 11.2 µs | +2.71% |
Tip
Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.
Comparing ci/codspeed-walltime (f2227e0) with master (d9e925a)
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## master #1743 +/- ##
=======================================
Coverage 97.98% 97.98%
=======================================
Files 183 183
Lines 16856 16856
Branches 3856 3856
=======================================
Hits 16516 16516
Misses 250 250
Partials 90 90
Flags with carried forward coverage won't be shown. Click here to find out more.
🚀 New features to boost your workflow:
|
Too many benchmarks in a single uploadThe performance report could not be generated because there were too many benchmarks in a single upload to CodSpeed. We recommend sharding your benchmarks into smaller uploads, with max 1000 benchmarks per upload. See the documentation for more information. |
Walltime trial on CodSpeed macro runners (run 36396100833)The walltime jobs ran on
No single job uploads more than 429 benchmarks ( Cost per pushThe 6 walltime jobs took ~56 min in total, so ~10 pushes/month fit in the free tier. Most of it is per-job setup:
Building once (e.g. on the free StabilityThis is the spread between the 5 repetitions of the internal benchmarks (129 benchmarks, stdev/mean):
The Graviton tail comes from the interpreter Other findings
Before un-drafting
Parked for now. 🤖 Generated with Claude Code |
The CodSpeed simulation counts the instructions, so it misses what only
shows in the time: the cache and branch prediction effects. This adds a
CircleCI job running the evmone and precompiles benchmarks with the
CodSpeed walltime instrument on a dedicated VM, which measures stably
enough without CodSpeed's own bare-metal runners.
🤖 Generated with Claude Code