Skip to content

Conversation

@mkroening
Copy link
Member

@mkroening mkroening commented Dec 10, 2025

This allows failing the benchmarks fast.

Depends on hermit-os/hermit-bench#12.

@mkroening mkroening self-assigned this Dec 10, 2025
@mkroening mkroening requested a review from jounathaen December 10, 2025 10:35
@mkroening mkroening marked this pull request as ready for review December 10, 2025 10:47
@mkroening mkroening force-pushed the hermit-bench-fail-fast branch from a68d2e0 to c91b55e Compare December 10, 2025 11:19
@mkroening mkroening force-pushed the hermit-bench-fail-fast branch from c91b55e to 1917739 Compare December 10, 2025 15:52
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark Results

Benchmark Current: 1917739 Previous: c475f3d Performance Ratio
startup_benchmark Build Time 115.39 s 116.79 s 0.99
startup_benchmark File Size 0.87 MB 0.87 MB 1.00
Startup Time - 1 core 0.98 s (±0.02 s) 0.99 s (±0.02 s) 0.99
Startup Time - 2 cores 0.98 s (±0.03 s) 0.99 s (±0.03 s) 0.99
Startup Time - 4 cores 0.99 s (±0.02 s) 0.99 s (±0.03 s) 1.00
multithreaded_benchmark Build Time 112.78 s 118.35 s 0.95
multithreaded_benchmark File Size 0.97 MB 0.97 MB 1.00
Multithreaded Pi Efficiency - 2 Threads 84.79 % (±9.44 %) 84.11 % (±8.23 %) 1.01
Multithreaded Pi Efficiency - 4 Threads 43.80 % (±3.41 %) 42.37 % (±3.77 %) 1.03
Multithreaded Pi Efficiency - 8 Threads 24.55 % (±2.37 %) 24.15 % (±2.04 %) 1.02
micro_benchmarks Build Time 117.55 s 117.78 s 1.00
micro_benchmarks File Size 0.98 MB 0.98 MB 1.00
Scheduling time - 1 thread 71.52 ticks (±4.08 ticks) 72.84 ticks (±4.36 ticks) 0.98
Scheduling time - 2 threads 41.13 ticks (±5.21 ticks) 39.85 ticks (±2.90 ticks) 1.03
Micro - Time for syscall (getpid) 3.29 ticks (±0.45 ticks) 3.39 ticks (±0.50 ticks) 0.97
Memcpy speed - (built_in) block size 4096 63457.65 MByte/s (±44985.87 MByte/s) 64089.85 MByte/s (±45883.58 MByte/s) 0.99
Memcpy speed - (built_in) block size 1048576 29019.21 MByte/s (±23947.78 MByte/s) 29036.32 MByte/s (±23970.81 MByte/s) 1.00
Memcpy speed - (built_in) block size 16777216 24018.47 MByte/s (±20182.57 MByte/s) 25048.36 MByte/s (±21133.12 MByte/s) 0.96
Memset speed - (built_in) block size 4096 64047.68 MByte/s (±45371.77 MByte/s) 64765.62 MByte/s (±46300.69 MByte/s) 0.99
Memset speed - (built_in) block size 1048576 29757.18 MByte/s (±24370.30 MByte/s) 29809.98 MByte/s (±24413.84 MByte/s) 1.00
Memset speed - (built_in) block size 16777216 24767.82 MByte/s (±20673.25 MByte/s) 25837.04 MByte/s (±21645.96 MByte/s) 0.96
Memcpy speed - (rust) block size 4096 58880.86 MByte/s (±43376.38 MByte/s) 58280.06 MByte/s (±42484.03 MByte/s) 1.01
Memcpy speed - (rust) block size 1048576 28681.92 MByte/s (±23807.37 MByte/s) 29053.33 MByte/s (±24041.98 MByte/s) 0.99
Memcpy speed - (rust) block size 16777216 23978.84 MByte/s (±20126.84 MByte/s) 23804.38 MByte/s (±20075.21 MByte/s) 1.01
Memset speed - (rust) block size 4096 59690.57 MByte/s (±43877.15 MByte/s) 58985.11 MByte/s (±42896.68 MByte/s) 1.01
Memset speed - (rust) block size 1048576 29456.45 MByte/s (±24247.87 MByte/s) 29823.38 MByte/s (±24478.78 MByte/s) 0.99
Memset speed - (rust) block size 16777216 24752.54 MByte/s (±20642.56 MByte/s) 24576.09 MByte/s (±20586.27 MByte/s) 1.01
alloc_benchmarks Build Time 115.10 s 116.21 s 0.99
alloc_benchmarks File Size 0.95 MB 0.94 MB 1.00
Allocations - Allocation success 100.00 % 100.00 % 1
Allocations - Deallocation success 100.00 % 100.00 % 1
Allocations - Pre-fail Allocations 100.00 % 100.00 % 1
Allocations - Average Allocation time 6189.90 Ticks (±73.45 Ticks) 6222.89 Ticks (±74.29 Ticks) 0.99
Allocations - Average Allocation time (no fail) 6189.90 Ticks (±73.45 Ticks) 6222.89 Ticks (±74.29 Ticks) 0.99
Allocations - Average Deallocation time 1197.47 Ticks (±69.82 Ticks) 1357.49 Ticks (±148.07 Ticks) 0.88
mutex_benchmark Build Time 108.52 s 113.89 s 0.95
mutex_benchmark File Size 0.97 MB 0.97 MB 1.00
Mutex Stress Test Average Time per Iteration - 1 Threads 13.26 ns (±0.59 ns) 13.38 ns (±0.63 ns) 0.99
Mutex Stress Test Average Time per Iteration - 2 Threads 13.94 ns (±0.86 ns) 14.56 ns (±1.06 ns) 0.96

This comment was automatically generated by workflow using github-action-benchmark.

@mkroening mkroening added this pull request to the merge queue Dec 10, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Dec 10, 2025
@mkroening mkroening added this pull request to the merge queue Dec 10, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Dec 10, 2025
@mkroening mkroening added this pull request to the merge queue Dec 10, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Dec 10, 2025
@mkroening mkroening added this pull request to the merge queue Dec 10, 2025
Merged via the queue into main with commit 4fb1826 Dec 10, 2025
19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants