Skip to content

perf(bench): Wave 0 full-pipeline throughput on one A6000 (binding resource per stage) - #242

Merged
davidamacey merged 4 commits into
mainfrom
perf/wave0-full-throughput
Oct 11, 2026
Merged

davidamacey merged 4 commits into
mainfrom
perf/wave0-full-throughput

Conversation

@davidamacey

Copy link
Copy Markdown
Owner

Refs #45, #210, #230. Also opens #239, #240, #241.

Extends the v0.6.0 baseline from the 4-client COCO run to the whole pipeline on one RTX A6000 (GPU 2, idle, FP16 PE engine, v0.5.0 images, isolated project, loopback only), 3 repetitions, medians in docs/PERFORMANCE.md ("0.6.0 Wave 0: full-pipeline throughput"), raw JSON in docs/benchmarks/v060_wave0_*.json.

Headlines

Code: wave0_suite.py, wave0_probes.py, wave0_lib.py, wave0_report.py, os_write_ceiling.py, ingest_micro_profile.py; baseline_suite.py gains --skip-cluster, --skip-settle and a pluggable gauges class. Tests under tests/bench and tests/datasets.

Checks: pre-commit run --from-ref origin/main --to-ref HEAD exits 0, scripts/docs/check_docs_vs_code.py clean, pytest tests/bench tests/datasets passes.

…tion photo set

wave0_suite.py sweeps client concurrency and Triton instance, queue-delay and preferred-batch arms (applied and restored through the model store), measures per-endpoint stage cost, and attributes API CPU with a thread census and py-spy. os_write_ceiling.py replays ingest-shaped documents into fresh indexes with the real mapping. ingest_micro_profile.py times the per-image primitives, wave0_report.py renders the tables. fetch_hires_set.py pins 500 CC-licensed 12 to 24 MP photos (commons_hires_500.json). baseline_suite.py gains --skip-cluster and --skip-settle and a pluggable gauges class. Refs #45, #210, #230.
One A6000, FP16 PE engine, sets A (COCO) and B (public 12 to 24 MP photos): client sweep, Triton arms, faces and OCR stage cost, API CPU attribution, OpenSearch write ceiling, binding resource per stage, and what the serving trade study's ceiling table got right and wrong. Raw JSON under docs/benchmarks/. Refs #45, #210, #230.
@davidamacey davidamacey added this to the v0.6.0 milestone Oct 10, 2026
…ghput

# Conflicts:
#	CHANGELOG.md
#	docs/PERFORMANCE.md
@davidamacey
davidamacey merged commit 2d41b0e into main Oct 11, 2026
5 checks passed
@davidamacey
davidamacey deleted the perf/wave0-full-throughput branch October 11, 2026 21:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant