Skip to content

Split tests v1.1.0 - #5

Merged
vitko-bench-agent[bot] merged 1 commit into
mainfrom
release-1.1.0
Oct 5, 2026
Merged

vitko-bench-agent[bot] merged 1 commit into
mainfrom
release-1.1.0

Conversation

@vitko-bench-agent

Copy link
Copy Markdown
Contributor

parts: auto now chooses the number of parts by cost, with a new optimize input: cost, balanced (default) or speed.

  • Each part is a copy of the job and is billed for the time it runs. Each copy also repeats some start-up work, so splitting can cost more than it saves.
  • The step keeps a short history of its own runs and picks the number of parts that best fits optimize.
  • A step's first run measures it in one part and its second run in two parts. Two new unsplit-reason values say why a step ran in one part: learning and costs-more.
  • The README has a new section, "How many parts".
  • The CLI's own default wait for a busy runner is now 15 s. The action's wait-for-capacity input still defaults to 90.

parts: auto now chooses the number of parts by cost. Each part is a copy of
the job, billed for the time it runs, and each copy repeats some start-up
work, so splitting can cost more than it saves. The step keeps a short
history of its own runs and picks the number of parts by the new optimize
input: cost (split only when it costs no more), balanced (the default:
split when each extra billed second saves at least a second of waiting)
or speed. A step's first run measures it in one part and its second in
two parts; new unsplit-reason values learning and costs-more say when it
ran in one part for these reasons. The CLI's own default wait for a busy
runner is 15 s (the action's input still defaults to 90).
@vitko-bench-agent
vitko-bench-agent Bot merged commit 092a380 into main Oct 5, 2026
6 checks passed
@vitko-bench-agent
vitko-bench-agent Bot deleted the release-1.1.0 branch October 5, 2026 17:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant