Skip to content

Commit 87f0810

Browse files
ci(conformance): run the draft-spec server suite
Add a workflow step that runs the test:conformance:server:draft script after the existing active-suite step. The client job already covers the draft client scenarios via --suite all; add comments documenting that and the exact-version conformance pin. Both jobs intentionally stay continue-on-error: true for now; the comment in the workflow recommends removing it once the expected-failures baseline has proven stable so that unexpected failures and stale entries actually block.
1 parent d3991db commit 87f0810

1 file changed

Lines changed: 22 additions & 2 deletions

File tree

.github/workflows/conformance.yml

Lines changed: 22 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,14 @@
11
name: Conformance Tests
22

3+
# The conformance framework (@modelcontextprotocol/conformance) is pinned to an
4+
# exact version in test/conformance/package.json; new conformance releases are
5+
# adopted by deliberately bumping that pin (+ pnpm-lock.yaml). This workflow
6+
# stays as-is across bumps.
7+
#
8+
# Both jobs are still continue-on-error: true (advisory). Recommended next
9+
# step once the expected-failures baseline has proven stable: remove
10+
# continue-on-error so unexpected failures and stale baseline entries block.
11+
312
on:
413
push:
514
branches: [main]
@@ -30,7 +39,11 @@ jobs:
3039
cache-dependency-path: pnpm-lock.yaml
3140
- run: pnpm install
3241
- run: pnpm run build:all
33-
- run: pnpm run test:conformance:client:all
42+
# --suite all already includes the draft-spec client scenarios
43+
# (SEP-2575, SEP-2322, SEP-2243, SEP-2106, draft auth); known gaps
44+
# are listed in test/conformance/expected-failures.yaml.
45+
- name: Run client conformance (all suites, incl. draft)
46+
run: pnpm run test:conformance:client:all
3447

3548
server-conformance:
3649
runs-on: ubuntu-latest
@@ -48,4 +61,11 @@ jobs:
4861
cache-dependency-path: pnpm-lock.yaml
4962
- run: pnpm install
5063
- run: pnpm run build:all
51-
- run: pnpm run test:conformance:server
64+
# Dated-spec (active) suite: expected to stay fully green.
65+
- name: Run server conformance (active suite)
66+
run: pnpm run test:conformance:server
67+
# Draft-spec suite (SEP-2575 stateless, SEP-2322 MRTR, SEP-2549,
68+
# SEP-2243): known gaps are listed in expected-failures.yaml and
69+
# must be removed from the baseline as each milestone lands.
70+
- name: Run server conformance (draft suite)
71+
run: pnpm --filter @modelcontextprotocol/test-conformance run test:conformance:server:draft

0 commit comments

Comments
 (0)