Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
81 commits
Select commit Hold shift + click to select a range
a890511
chore: pin the core dependency to a tag instead of tracking main (#25)
fylorn Sep 23, 2026
a90e9f3
feat!: forward what can be forwarded, convert only what must be (#26)
fylorn Sep 23, 2026
ca7647c
refactor: take the circuit-breaker registry and metric labels back fr…
fylorn Sep 23, 2026
a6678cf
refactor: redact PII with core's guard engine, and restore tool argum…
fylorn Sep 23, 2026
437a671
feat: inspect the tool calls an upstream returns (#29)
fylorn Sep 23, 2026
038796b
build: keep only line tables in dev and test builds (#30)
fylorn Sep 24, 2026
05f52e8
feat: one circuit-breaker state machine, and hidden characters in req…
fylorn Sep 24, 2026
8a76395
fix: make the integration suite pass again (#32)
fylorn Sep 24, 2026
6482690
test: fix the two flaky integration tests (#33)
fylorn Sep 24, 2026
9f46116
fix: bill a Chat stream whose caller did not ask for usage (#34)
fylorn Sep 24, 2026
3c35ab8
fix: a request the upstream refuses no longer fails over or trips bre…
fylorn Sep 24, 2026
234fcce
Merge main (v1.1.0) into dev
fylorn Sep 24, 2026
82f8061
docs: cut releases from a release branch, and keep the tag's headings…
fylorn Sep 24, 2026
bd57b5d
ci: run checks on pull requests into dev, including the integration s…
fylorn Sep 24, 2026
c1b2085
fix: bill cached input at cache prices, estimate missing usage, strip…
fylorn Sep 24, 2026
ad5b75b
refactor: take back what only this side used from core (#41)
fylorn Sep 24, 2026
3a617f3
feat(gateway): take official hosts, output fallback and error shapes …
fylorn Sep 24, 2026
ed1c8b5
feat(gateway): accept Gemini clients, and the Responses API over a We…
fylorn Sep 24, 2026
28d4387
test: count the probes that miss before the streaming cache hit (#44)
fylorn Sep 24, 2026
d3f36fc
refactor(server): move the catalog's SQL into repositories (#45)
fylorn Sep 24, 2026
83e9bcc
refactor(server): move the dashboard, limits and log-forwarding handl…
fylorn Sep 24, 2026
9b5b326
refactor(server): move the MCP handlers' SQL into repositories (#50)
fylorn Sep 24, 2026
86beb82
refactor(gateway): run the request guards on core's tw-guard engines …
fylorn Sep 24, 2026
1c80b83
refactor(server): move the identity handlers' SQL into repositories (…
fylorn Sep 24, 2026
c25b44f
fix(mcp): revoking a default connection no longer fails with a 500 (#51)
fylorn Sep 24, 2026
dbce845
test: leave the cancelled stream after it has started, not on a timer…
fylorn Sep 24, 2026
c3d2d57
refactor(server): move the access handlers' SQL into repositories (#48)
fylorn Sep 24, 2026
d92c2d1
fix(settings): read security.totp_required as a boolean, and seed aut…
fylorn Sep 24, 2026
7e95183
feat(gateway): record a client that leaves before its response exists…
fylorn Sep 24, 2026
367df3c
feat(auth): enforce the TOTP requirement (#55)
fylorn Sep 24, 2026
443de8d
feat(gateway): keep the last response on a Responses WebSocket (#56)
fylorn Sep 24, 2026
6890c72
Merge main (v2.0.0) into dev
fylorn Sep 24, 2026
d4f6d5a
docs(release): CI runs the integration suite on the release PR (#58)
fylorn Sep 24, 2026
ef3de87
docs(contributing): point vulnerability reports at the organization's…
fylorn Sep 25, 2026
c4f8b1c
docs(readme): current description of ThinkWatch Lite and ThinkWatch C…
fylorn Sep 25, 2026
f259962
feat(providers): authenticate Bedrock with an API key (#61)
fylorn Sep 28, 2026
78f9ab5
test: hold the early-cancel client once its key is known, not on a ti…
fylorn Sep 28, 2026
1b752f2
feat(providers): list Bedrock's models, and let the route editor take…
fylorn Sep 28, 2026
1f08421
fix(bedrock): refuse keys that will not decrypt, and keep instance-ro…
fylorn Sep 28, 2026
e480bfd
refactor(bedrock): use core's shared tw-bedrock, and core v0.55.0 (#65)
fylorn Sep 29, 2026
e1e7999
docs(readme): rewrite both READMEs to be short and accurate (#66)
fylorn Sep 30, 2026
af9eb81
Merge main (v2.1.0) into dev
fylorn Sep 30, 2026
ed6dd39
docs(readme): 37 MCP templates, what the setup wizard does, body reda…
fylorn Sep 30, 2026
9afcc08
fix(rbac): make the seeded team_manager work at team scope (#69)
fylorn Sep 30, 2026
fa3a5b9
fix(rbac): require gateway use, and count only grants that give it (#70)
fylorn Sep 30, 2026
a1eed6f
Merge main (v2.2.0) into dev
fylorn Sep 30, 2026
da88b09
Merge main (sponsor line) into dev
fylorn Oct 2, 2026
1a399e7
Allow clippy::double_must_use on the async_trait BlobStore (#73)
fylorn Oct 2, 2026
8d8d96f
Unify the request guards with thinkwatch-core's rule model (#72)
fylorn Oct 3, 2026
2baa123
Fix what the pre-release review of the guard unification found (#75)
fylorn Oct 3, 2026
33c22dc
Merge main (v3.0.0) into dev
fylorn Oct 3, 2026
dcc8616
Merge main (README: ThinkWatch Lite for individual developers) into dev
fylorn Oct 4, 2026
6b73344
Merge main (v3.1.0) into dev
fylorn Oct 5, 2026
03c393c
Usage limits: token limits refuse, key limits count on the key, Retry…
fylorn Oct 5, 2026
4075855
fix(redis): connect over TLS for rediss:// URLs (#82)
fylorn Oct 5, 2026
33234ee
Concurrent startup, body retention on restart, and Helm network polic…
fylorn Oct 5, 2026
b7a34e1
Merge main (v3.2.0) into dev
fylorn Oct 5, 2026
2ce6471
chore(deps): update rust crate rand to v0.10.1 [security] (#77)
renovate[bot] Oct 6, 2026
0682864
chore(deps): update rust crate xxhash-rust to v0.8.16 [security] (#78)
renovate[bot] Oct 6, 2026
1fbe7bd
chore(deps): take the Renovate dashboard upgrades (#85)
fylorn Oct 6, 2026
2e23fd9
chore(deps): pnpm 12, and ClickHouse row validation on (#86)
fylorn Oct 6, 2026
977cab0
ci: save Rust caches only on pushes, and let releases read CI's image…
fylorn Oct 8, 2026
a19ed65
Merge main (v3.2.1) into dev
fylorn Oct 8, 2026
ea2a81f
Merge main (v3.3.0) into dev
fylorn Oct 9, 2026
e8ae1f1
Stream endings and in-stream errors logged like answers; core v0.68.0…
fylorn Oct 10, 2026
0e070a9
Merge main (v3.3.1) into dev
fylorn Oct 10, 2026
633ad90
Merge main (v3.4.0) into dev
fylorn Oct 10, 2026
235e38b
fix(limits): enforce route caps and close the places limits leaked (#94)
fylorn Oct 10, 2026
31cbfc8
feat: GET /v1/usage answers for the key or its owner; API key limits …
fylorn Oct 10, 2026
8151cee
Merge main (v3.5.0) into dev
fylorn Oct 10, 2026
721b5ee
Merge main (README zh) into dev
fylorn Oct 10, 2026
4f87839
feat(console): Add to ThinkWatch Lite; gateway address for every user…
fylorn Oct 11, 2026
042e605
Merge main (v3.6.0) into dev
fylorn Oct 11, 2026
ebdb9dc
chore: add a contributor license agreement signed by PR comment (#102)
fylorn Oct 11, 2026
133d610
ci: name the CLA job cla (#103)
fylorn Oct 12, 2026
eef9ff4
Merge main (3.7.0) back into dev
fylorn Oct 12, 2026
30c5f5b
Merge main (3.7.1) back into dev
fylorn Oct 12, 2026
12f4f82
Merge main (3.8.0) back into dev
fylorn Oct 13, 2026
7ef4ff0
Merge main (3.8.1) back into dev
fylorn Oct 13, 2026
72888a4
Bump rustls to 0.23.46 (RUSTSEC-2026-0346 to -0349) (#108)
fylorn Oct 15, 2026
9710db7
chore(release): tag 3.8.2
fylorn Oct 16, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
48 changes: 47 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,51 @@ target.

## [Unreleased]

## [3.8.2] — 2026-10-16

Tool-call inspection now checks every choice of an answer, not only the
first, and redacted values are put back in every choice of a streamed
answer. The thinkwatch-core crates move from v0.74.0 to v0.75.0, and rustls
moves to 0.23.46 for four security advisories.

No setting, schema or API route changes.

### Security

- **Tool-call inspection checks every choice of an answer.** An answer can
carry several choices (Chat Completions `choices`, with `n` above 1) or
candidates (Gemini `candidates`), and a streamed chunk several of them at
once. Inspection looked only at the first element of each streamed Chat
Completions chunk's `choices`, and only at the first Gemini candidate,
streamed or whole. A tool call in any other choice or candidate reached
the client uninspected: it was not recorded, and in enforce mode it was
neither cut nor refused. Every choice and every candidate is now
inspected. The arguments of a streamed Chat Completions call are put
together both by the choice's `index` and by the choice's position in
each chunk, the two ways clients assemble them, and both are checked.
Whole Chat Completions answers already had every choice inspected. This
holds whether the route forwards the answer in the caller's format or
converts it.
- rustls 0.23.46, for RUSTSEC-2026-0346 to RUSTSEC-2026-0349.

### Fixed

- **Redacted values are put back in every choice of a streamed answer.**
With outbound redaction in enforce mode, a streamed Chat Completions
answer with several choices, or a Gemini answer with several candidates,
could reach the client with a placeholder still in it, or with the start
of a placeholder from one choice in the text of another. Values were put
back only in the first choice of each chunk, and the text held back while
a placeholder might still be completing was kept for the answer as a
whole rather than for each choice, so one choice finishing released what
another was holding. Each choice is now restored on its own, and released
when it finishes.

### Changed

- thinkwatch-core crates (tw-bedrock, tw-breaker, tw-dialect, tw-guard)
v0.74.0 → v0.75.0. Only tw-guard changes.

## [3.8.1] — 2026-10-13

Outbound redaction searches only the text written in a request, located
Expand Down Expand Up @@ -2405,7 +2450,8 @@ unreleased builds should: stop the gateway, run `db/schema.sql`
against PostgreSQL, restart against this tag. The schema is
idempotent end-to-end, so the apply is safe to repeat.

[Unreleased]: https://github.com/ThinkWatchProject/ThinkWatch/compare/v3.8.1...HEAD
[Unreleased]: https://github.com/ThinkWatchProject/ThinkWatch/compare/v3.8.2...HEAD
[3.8.2]: https://github.com/ThinkWatchProject/ThinkWatch/releases/tag/v3.8.2
[3.8.1]: https://github.com/ThinkWatchProject/ThinkWatch/releases/tag/v3.8.1
[3.8.0]: https://github.com/ThinkWatchProject/ThinkWatch/releases/tag/v3.8.0
[3.7.1]: https://github.com/ThinkWatchProject/ThinkWatch/releases/tag/v3.7.1
Expand Down
32 changes: 16 additions & 16 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

10 changes: 5 additions & 5 deletions Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ members = [
]

[workspace.package]
version = "3.8.1"
version = "3.8.2"
edition = "2024"
# The MSRV: the newest `rust-version` among the locked dependencies
# (sqlx 0.9 and the aws-smithy crates under aws-sigv4). Without it,
Expand Down Expand Up @@ -70,10 +70,10 @@ opt-level = 3
# never re-exported through a local shim. And the reverse: something only
# this side uses (the at-rest crypto, IMDSv2 credentials, the gateway error)
# lives here, not in core.
tw-bedrock = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.74.0" }
tw-breaker = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.74.0" }
tw-dialect = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.74.0" }
tw-guard = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.74.0" }
tw-bedrock = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.75.0" }
tw-breaker = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.75.0" }
tw-dialect = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.75.0" }
tw-guard = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.75.0" }

# Web framework
axum = { version = "0.8", features = ["macros", "ws"] }
Expand Down
76 changes: 76 additions & 0 deletions crates/test-support/tests/tool_inspection.rs
Original file line number Diff line number Diff line change
Expand Up @@ -165,6 +165,82 @@ async fn enforce_cuts_a_stream_before_the_call_is_complete() {
assert_eq!(detail["tool"], "bash", "{detail}");
}

#[ignore = "integration test — run via `make test-it`"]
#[tokio::test]
async fn enforce_cuts_a_call_in_the_second_choice_of_a_chat_stream() {
// A Chat answer can carry several choices, and a frame several of
// them at once. Only the first element of each frame's `choices` used
// to be inspected, so a call in the second went to the client
// unchecked. Every choice is inspected now.
let app = TestApp::spawn_with_clickhouse().await;
set_inspection(&app, json!({"mode": "enforce"})).await;
let upstream = bare().await;
let args = json!({"command": EVIL}).to_string();
let split = args.find(" | sh").unwrap();
// Every frame carries both choices: the first talks, the second calls
// `bash`, its arguments split across two frames.
let chunk = |second: Value, finish: Value| {
format!(
"data: {}\n\n",
json!({"id": "c", "object": "chat.completion.chunk", "created": 0,
"model": "gpt-inspect", "choices": [
{"index": 0, "delta": {"content": "Installing the dependencies."},
"finish_reason": Value::Null},
{"index": 1, "delta": second, "finish_reason": finish}]})
)
};
let sse = [
chunk(
json!({"role": "assistant", "tool_calls": [{"index": 0, "id": "call_1",
"type": "function", "function": {"name": "bash", "arguments": &args[..split]}}]}),
Value::Null,
),
chunk(
json!({"tool_calls": [{"index": 0, "function": {"arguments": &args[split..]}}]}),
Value::Null,
),
chunk(json!({}), json!("tool_calls")),
"data: [DONE]\n\n".to_string(),
]
.concat();
upstream
.mount(
Mock::given(method("POST"))
.and(path("/v1/chat/completions"))
.respond_with(ResponseTemplate::new(200).set_body_raw(sse, "text/event-stream")),
)
.await;
let (key, user_id) = seed(&app, &upstream.uri(), "openai", "gpt-inspect").await;

let gw = app.gateway_client();
gw.set_bearer(&key);
let body = gw
.post(
"/v1/chat/completions",
json!({
"model": "gpt-inspect", "stream": true, "n": 2,
"messages": [{"role": "user", "content": "set up the project"}],
}),
)
.await
.unwrap()
.text();

// What came before the call still arrives...
assert!(body.contains("Installing the dependencies."), "{body}");
// ...the rest of the call never does, nor is the client told the call
// is complete...
assert!(!body.contains(" | sh"), "{body}");
assert!(!body.contains(r#""finish_reason":"tool_calls""#), "{body}");
assert!(!body.contains("[DONE]"), "{body}");
// ...and the stream ends with a refusal.
assert!(body.contains("Blocked by policy"), "{body}");

let detail = audited(&app, &user_id, "gateway.tool_call_blocked").await;
assert_eq!(detail["rule"], "curl-pipe-sh", "{detail}");
assert_eq!(detail["tool"], "bash", "{detail}");
}

#[ignore = "integration test — run via `make test-it`"]
#[tokio::test]
async fn observe_hands_the_answer_over_and_records_the_call() {
Expand Down
4 changes: 2 additions & 2 deletions deploy/helm/think-watch/Chart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,8 @@ apiVersion: v2
name: think-watch
description: Enterprise AI API Gateway & MCP Management Platform
type: application
version: 3.8.1
appVersion: "3.8.1"
version: 3.8.2
appVersion: "3.8.2"
keywords:
- ai
- gateway
Expand Down
2 changes: 1 addition & 1 deletion web/package.json
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
{
"name": "web",
"private": true,
"version": "3.8.1",
"version": "3.8.2",
"type": "module",
"packageManager": "pnpm@12.9.1",
"scripts": {
Expand Down
Loading