Skip to content

Commit b9bbcda

Browse files
test(conformance): bump referee 0.2.0-alpha.4 -> 0.2.0-alpha.5
The alpha.5 referee carries conformance#353 (the spec#2907 error-code renumber), so the SDK and referee are aligned on -32020/-32021/-32022 and the renumber-mismatch expected-failures recorded in the previous commit burn here: - expected-failures.yaml: drop client request-metadata; drop the entire server section (http-custom-header-server-validation, http-header-validation, server-stateless) -> server: []. - expected-failures.2026-07-28.yaml: drop client request-metadata; drop the three server renumber cells (json-schema-2020-12 stays). alpha.5 also carries conformance#359 which gates the SEP-2350 scope-step-up WARNING to 2026-07-28+, so auth/scope-step-up burns on the 2025 client leg (it remains in the 2026-07-28 baseline where it still fails on the 2026 connection-lifecycle gap). alpha.5 ships the conformance#262 SEP-2663 tasks-* scenarios, but they are extension-sourced (source.extensionId io.modelcontextprotocol/tasks) and do not run against a server that does not advertise the extension, so no new expected-failures entries are needed; they will appear when ext-tasks lands. Header NOTE in both files flipped from 'AHEAD of this referee' to 'aligned with what this referee asserts'. README unchanged (does not reference the pin version).
1 parent 45a888d commit b9bbcda

4 files changed

Lines changed: 19 additions & 54 deletions

File tree

pnpm-lock.yaml

Lines changed: 5 additions & 5 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

test/conformance/expected-failures.2026-07-28.yaml

Lines changed: 3 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -15,12 +15,9 @@
1515
# release pinned in package.json. Newer conformance releases are adopted by
1616
# deliberately bumping the pin and reconciling this file in the same change.
1717
#
18-
# NOTE: the SDK's modern-path rejection codes are AHEAD of this referee's
19-
# assignments — the SDK has adopted the spec#2907 / conformance#353 renumber
20-
# (-32020 / -32021 / -32022) on both the emission and recognition paths,
21-
# while the 0.2.0-alpha.4 referee still asserts the pre-renumber codes
22-
# (-32001 / -32003 / -32004). The affected cells are listed below and burn when
23-
# the conformance pin bumps to >=0.2.0-alpha.5 (carries conformance#353).
18+
# NOTE: the SDK's modern-path rejection codes are aligned with what this
19+
# referee asserts — both sides have adopted the spec#2907 / conformance#353
20+
# renumber (-32020 / -32021 / -32022) on emission and recognition.
2421
#
2522
# Entries are grouped by what unblocks them. As each gap closes the
2623
# corresponding scenarios start passing and MUST be removed from this list
@@ -69,23 +66,10 @@ client:
6966
# when PRM authorization_servers changes.
7067
- auth/authorization-server-migration
7168

72-
# --- spec#2907 error-code renumber (SDK ahead of referee) ---
73-
# SDK adopted spec#2907 renumber; burns when conformance pin bumps to
74-
# >=0.2.0-alpha.5 (carries conformance#353). Same failure as the 2025 leg.
75-
- request-metadata
76-
7769
server:
7870
# --- Carried-forward scenarios (also run by the 2025 legs) ---
7971
# Pre-existing fixture/baseline bug: the fixture tool's schema is a plain
8072
# Zod object with none of the JSON Schema 2020-12 keywords the scenario
8173
# checks; it fails identically at 2025 in `--suite all` (not a 2026-path
8274
# regression).
8375
- json-schema-2020-12
84-
# --- spec#2907 error-code renumber (SDK ahead of referee) ---
85-
# SDK adopted spec#2907 renumber; burns when conformance pin bumps to
86-
# >=0.2.0-alpha.5 (carries conformance#353). SDK emits -32020/-32021/-32022; the
87-
# alpha.4 referee asserts -32001/-32003/-32004. Same failure as the 2025
88-
# leg.
89-
- http-custom-header-server-validation
90-
- http-header-validation
91-
- server-stateless

test/conformance/expected-failures.yaml

Lines changed: 10 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -2,19 +2,16 @@
22
# CI exits 0 if only these fail, exits 1 on unexpected failures or stale entries.
33
#
44
# Baseline established against the published @modelcontextprotocol/conformance
5-
# release pinned in package.json (0.2.0-alpha.4). Newer conformance releases
5+
# release pinned in package.json (0.2.0-alpha.5). Newer conformance releases
66
# are adopted by deliberately bumping the package.json pin and reconciling
77
# this file in the same change.
88
#
9-
# NOTE: the SDK's modern-path rejection codes are AHEAD of this referee's
10-
# assignments — the SDK has adopted the spec#2907 / conformance#353 renumber
11-
# (-32020 HeaderMismatch / -32021 MissingRequiredClientCapability / -32022
12-
# UnsupportedProtocolVersion) on both the emission and recognition paths,
13-
# while the 0.2.0-alpha.4 referee still asserts the pre-renumber codes
14-
# (-32001 / -32003 / -32004). The affected cells are listed below and burn
15-
# when the conformance pin bumps to >=0.2.0-alpha.5 (carries conformance#353).
16-
# A missing _meta envelope (or missing protocolVersion key) still answers
17-
# -32602 on both sides.
9+
# NOTE: the SDK's modern-path rejection codes are aligned with what this
10+
# referee asserts — both sides have adopted the spec#2907 / conformance#353
11+
# renumber (-32020 HeaderMismatch / -32021 MissingRequiredClientCapability /
12+
# -32022 UnsupportedProtocolVersion) on emission and recognition. A missing
13+
# _meta envelope (or missing protocolVersion key) still answers -32602 on
14+
# both sides.
1815
#
1916
# Entries are grouped by SEP. As each SEP/milestone is implemented in the SDK the
2017
# corresponding scenarios start passing and MUST be removed from this list (the
@@ -40,26 +37,10 @@ client:
4037
- auth/offline-access-not-supported
4138

4239
# --- Pre-existing scenarios that fail on checks added after conformance 0.1.15 ---
43-
# SEP-2350 (scope step-up): WARNING-only — client does not compute the union of
44-
# previously requested and newly challenged scopes on re-authorization; the
45-
# expected-failures evaluator counts WARNINGs as failures.
46-
- auth/scope-step-up
4740
# SEP-990 (enterprise-managed authorization extension): no fixture handler /
4841
# client support for the token-exchange + JWT bearer flow.
4942
- auth/enterprise-managed-authorization
5043

51-
# --- spec#2907 error-code renumber (SDK ahead of referee) ---
52-
# SDK adopted spec#2907 renumber; burns when conformance pin bumps to
53-
# >=0.2.0-alpha.5 (carries conformance#353). The alpha.4 mock rejects with
54-
# -32004 where the SDK probe classifier now recognises -32022, so the
55-
# corrective continuation never fires.
56-
- request-metadata
57-
58-
server:
59-
# --- spec#2907 error-code renumber (SDK ahead of referee) ---
60-
# SDK adopted spec#2907 renumber; burns when conformance pin bumps to
61-
# >=0.2.0-alpha.5 (carries conformance#353). SDK emits -32020/-32021/-32022;
62-
# the alpha.4 referee asserts -32001/-32003/-32004.
63-
- http-custom-header-server-validation
64-
- http-header-validation
65-
- server-stateless
44+
# No server entries at the 0.2.0-alpha.5 referee — the spec#2907 renumber-mismatch
45+
# cells burned at this pin.
46+
server: []

test/conformance/package.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@
4040
"test:conformance:all": "pnpm run test:conformance:client:all && pnpm run test:conformance:server:all"
4141
},
4242
"devDependencies": {
43-
"@modelcontextprotocol/conformance": "0.2.0-alpha.4",
43+
"@modelcontextprotocol/conformance": "0.2.0-alpha.5",
4444
"@modelcontextprotocol/client": "workspace:^",
4545
"@modelcontextprotocol/server": "workspace:^",
4646
"@modelcontextprotocol/core": "workspace:^",

0 commit comments

Comments
 (0)