Skip to content

Compile custom assistant proposals and clarify generated experiments - #470

Open
ctfbruce wants to merge 6 commits into
mainfrom
fix/ai-reliability-integrated
Open

ctfbruce wants to merge 6 commits into
mainfrom
fix/ai-reliability-integrated

Conversation

@ctfbruce

@ctfbruce ctfbruce commented Nov 9, 2026 •

Copy link
Copy Markdown
Collaborator

Generated custom blocks could pass graph validation and fail only when the user clicked Build. Hosted assistant proposals now compile custom code through the existing offline worker before acceptance, with one correction for code diagnostics and separate busy/unavailable errors. Existing compiler capacity, authentication and cancellation behavior are preserved.

Custom blocks retain optional descriptions without changing legacy document fingerprints. Output-availability checks continue up to loop boundaries. Authoring guidance preserves complete measurements and independent failure handling while grouping complex processing into expandable stages.

Validation: full Studio, workflow and dispatcher API package tests pass on Linux. Real-worker tests cover invalid Go followed by a compiled correction. A generated two-participant DNS/TCP experiment passes real WASI tests for successful exchange, partial DNS failure, missing peer and refused TCP, retaining unavailable values rather than zero timings. Complex generation latency remains approximately 52 seconds; no general speed improvement is claimed.

Deploy the matching hosted worker/SDK and console together with the dispatcher: older workers reject the new description field. Compilation does not establish network reachability or measurement correctness. Build still compiles the accepted source separately.

Updates the existing Echo dependency to v4.16.3, whose upstream patch fixes CVE-2026-118651 and CVE-2026-118653. Affected packages pass. The Go vulnerability database still lacks the fixed v4 range for GO-2026-6872 and GO-2026-6875, so the required scanner currently remains red even on the patched version. No exception or suppression is added; this is not yet ready to merge. Upstream release: https://github.com/labstack/echo/releases/tag/v4.16.3.

Fixes #469.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Validate generated custom blocks before accepting assistant proposals

1 participant