docs: republish the macOS benchmarks from a pre-release run at 5c8b9769 #467

Merged
natsukium merged 1 commit from docs/republish-macos-bench-5c8b9769 into main 2026-09-26 08:57:44 +09:00
Owner

The published macOS figures came from 9d1d842f, which predates the parse, render and startup work that will ship in the release (#396 through #465). This republishes the macOS section of docs/reference/benchmarks.md, its charts and README's headline table from a fresh full run at 5c8b9769 (nix build .#felis). The Linux section is untouched.

Run. crossterm.py run over all eight suites and the full field, ROUNDS=3 with rotated order, at the published page's font pin (Menlo 14 pt). paneru was stopped for the whole run. Every leg completed in every round: no refused, unfinished or retried legs.

What moved.

  • The grid is 120x35 at the same 960x600 window, 13% more cells than the published 106x35 pin (felis at 9d1d842f also opens at 120x35 under this config, so the difference is in the pin, not in felis). DOOM-fire fell by 8-12% for every terminal, not only felis.
  • kittenbench: felis now leads all four rows, ASCII and Unicode included (599 and 710 MB/s against ghostty-tip's 542 and 574), with ranges apart.
  • termbench many_lines 260 MB/s (was 212) and sgr_fg_lines 317 (was 237); felis leads every row.
  • Startup: cold 99 ms, warm 91 ms (was 126 and 144); warm is now below cold in every round.
  • Idle footprint rose from 33.2 to 50.1 MB (client 46.1 MB, daemon 4.0 MB), consistent across rounds (50.0-50.2), while every other terminal's idle figure moved by at most 2 MB. felis falls behind wezterm (46.8) and alacritty (47.9) on this row, and README's "under 33 MB" claim is corrected to what was measured. The cause is being investigated separately.
  • Mean latency 24.6 ms against alacritty's 24.3, with overlapping ranges; no winner is claimed.

Kept on the page. Some legs ran more than 1.0 above the starting load average of 2.2, mostly felis's and ghostty-tip's in rounds 2 and 3; each chart names them and the three rounds agree.

Verified: every figure came from the harness's report.md (per-round artifacts checked for the prose claims); just prose-check clean; treefmt applied.
Assisted-by: Claude Code

The published macOS figures came from `9d1d842f`, which predates the parse, render and startup work that will ship in the release (#396 through #465). This republishes the macOS section of `docs/reference/benchmarks.md`, its charts and README's headline table from a fresh full run at `5c8b9769` (`nix build .#felis`). The Linux section is untouched. **Run.** `crossterm.py run` over all eight suites and the full field, `ROUNDS=3` with rotated order, at the published page's font pin (Menlo 14 pt). paneru was stopped for the whole run. Every leg completed in every round: no refused, unfinished or retried legs. **What moved.** - The grid is 120x35 at the same 960x600 window, 13% more cells than the published 106x35 pin (felis at `9d1d842f` also opens at 120x35 under this config, so the difference is in the pin, not in felis). DOOM-fire fell by 8-12% for every terminal, not only felis. - kittenbench: felis now leads all four rows, ASCII and Unicode included (599 and 710 MB/s against ghostty-tip's 542 and 574), with ranges apart. - termbench `many_lines` 260 MB/s (was 212) and `sgr_fg_lines` 317 (was 237); felis leads every row. - Startup: cold 99 ms, warm 91 ms (was 126 and 144); warm is now below cold in every round. - Idle footprint rose from 33.2 to 50.1 MB (client 46.1 MB, daemon 4.0 MB), consistent across rounds (50.0-50.2), while every other terminal's idle figure moved by at most 2 MB. felis falls behind wezterm (46.8) and alacritty (47.9) on this row, and README's "under 33 MB" claim is corrected to what was measured. The cause is being investigated separately. - Mean latency 24.6 ms against alacritty's 24.3, with overlapping ranges; no winner is claimed. **Kept on the page.** Some legs ran more than 1.0 above the starting load average of 2.2, mostly felis's and ghostty-tip's in rounds 2 and 3; each chart names them and the three rounds agree. Verified: every figure came from the harness's `report.md` (per-round artifacts checked for the prose claims); `just prose-check` clean; treefmt applied. Assisted-by: Claude Code
docs: republish the macOS benchmarks from a pre-release run at 5c8b9769
All checks were successful
darwin / detect relevant changes (pull_request) Successful in 14s
darwin / build felis (aarch64-darwin) (pull_request) Has been skipped
darwin / publish felis (aarch64-darwin) (pull_request) Has been skipped
windows / detect relevant changes (pull_request) Successful in 16s
windows / cargo nextest (Windows) (pull_request) Has been skipped
windows / frontend smoke (Windows) (pull_request) Has been skipped
windows / package felis (x86_64-pc-windows-msvc) (pull_request) Has been skipped
darwin / darwin docs-only no-op (pull_request) Successful in 0s
windows / windows docs-only no-op (pull_request) Successful in 1s
pr / nix flake check (pull_request) Successful in 26s
pr / cargo build / clippy / test / deny (pull_request) Successful in 1m47s
pr / wire schema is compatible with the base (pull_request) Successful in 14s
pr / frontend smoke (x86_64-linux) (pull_request) Successful in 42s
pr / publish felis (x86_64-linux) (pull_request) Has been skipped
windows / cargo clippy (Windows cross) (pull_request) Successful in 24s
9e05e474cb
The published macOS figures came from `9d1d842f`, which predates the parse, render and startup work that will ship in the release (#396 through #465). This republishes the macOS section of `docs/reference/benchmarks.md`, its charts and README's headline table from a fresh full run at `5c8b9769` (`nix build .#felis`). The Linux section is untouched.

**Run.** `crossterm.py run` over all eight suites and the full field, `ROUNDS=3` with rotated order, at the published page's font pin (Menlo 14 pt). paneru was stopped for the whole run. Every leg completed in every round: no refused, unfinished or retried legs.

**What moved.**

- The grid is 120x35 at the same 960x600 window: felis's cell is now 8 px wide instead of 9 (#411 rounds the cell width to the nearest pixel), so the pin holds 13% more cells. DOOM-fire fell by 8-12% for every terminal, not only felis.
- kittenbench: felis now leads all four rows, ASCII and Unicode included (599 and 710 MB/s against ghostty-tip's 542 and 574), with ranges apart.
- termbench `many_lines` 260 MB/s (was 212) and `sgr_fg_lines` 317 (was 237); felis leads every row.
- Startup: cold 99 ms, warm 91 ms (was 126 and 144); warm is now below cold in every round.
- Idle footprint rose from 33.2 to 50.1 MB (client 46.1 MB, daemon 4.0 MB), consistent across rounds (50.0-50.2), while every other terminal's idle figure moved by at most 2 MB. felis falls behind wezterm (46.8) and alacritty (47.9) on this row, and README's "under 33 MB" claim is corrected to what was measured. The cause is being investigated separately.
- Mean latency 24.6 ms against alacritty's 24.3, with overlapping ranges; no winner is claimed.

**Kept on the page.** Some legs ran more than 1.0 above the starting load average of 2.2, mostly felis's and ghostty-tip's in rounds 2 and 3; each chart names them and the three rounds agree.

Verified: every figure came from the harness's `report.md` (per-round artifacts checked for the prose claims); `just prose-check` clean; treefmt applied.
Assisted-by: Claude Code
natsukium force-pushed docs/republish-macos-bench-5c8b9769 from 9e05e474cb
All checks were successful
darwin / detect relevant changes (pull_request) Successful in 14s
darwin / build felis (aarch64-darwin) (pull_request) Has been skipped
darwin / publish felis (aarch64-darwin) (pull_request) Has been skipped
windows / detect relevant changes (pull_request) Successful in 16s
windows / cargo nextest (Windows) (pull_request) Has been skipped
windows / frontend smoke (Windows) (pull_request) Has been skipped
windows / package felis (x86_64-pc-windows-msvc) (pull_request) Has been skipped
darwin / darwin docs-only no-op (pull_request) Successful in 0s
windows / windows docs-only no-op (pull_request) Successful in 1s
pr / nix flake check (pull_request) Successful in 26s
pr / cargo build / clippy / test / deny (pull_request) Successful in 1m47s
pr / wire schema is compatible with the base (pull_request) Successful in 14s
pr / frontend smoke (x86_64-linux) (pull_request) Successful in 42s
pr / publish felis (x86_64-linux) (pull_request) Has been skipped
windows / cargo clippy (Windows cross) (pull_request) Successful in 24s
to 56cc08bfcc
All checks were successful
darwin / detect relevant changes (pull_request) Successful in 14s
darwin / build felis (aarch64-darwin) (pull_request) Has been skipped
darwin / publish felis (aarch64-darwin) (pull_request) Has been skipped
darwin / darwin docs-only no-op (pull_request) Successful in 0s
windows / detect relevant changes (pull_request) Successful in 15s
windows / cargo nextest (Windows) (pull_request) Has been skipped
windows / frontend smoke (Windows) (pull_request) Has been skipped
windows / package felis (x86_64-pc-windows-msvc) (pull_request) Has been skipped
windows / windows docs-only no-op (pull_request) Successful in 1s
pr / nix flake check (pull_request) Successful in 12s
pr / cargo build / clippy / test / deny (pull_request) Successful in 2m10s
pr / wire schema is compatible with the base (pull_request) Successful in 15s
pr / frontend smoke (x86_64-linux) (pull_request) Successful in 24s
pr / publish felis (x86_64-linux) (pull_request) Has been skipped
windows / cargo clippy (Windows cross) (pull_request) Successful in 12s
2026-09-26 01:20:42 +09:00
Compare
natsukium deleted branch docs/republish-macos-bench-5c8b9769 2026-09-26 08:57:44 +09:00
Commenting is not possible because the repository is archived.
No description provided.