Skip to content

Commit 430ebda

Browse files
rubychildsclaude
andcommitted
chore(experiments): state the description cap on experiment-create-from-prompt too
The definition JSONs already carried the sentence for this tool; the yaml source now matches so a regeneration keeps it. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
1 parent 4417163 commit 430ebda

3 files changed

Lines changed: 4 additions & 3 deletions

File tree

‎products/experiments/mcp/tools.yaml‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -308,7 +308,8 @@ tools:
308308
experiment-prompt-templates for the allowed template keys. Builds one variant per version, each carrying a
309309
feature flag payload with the prompt name and version so the SDK can resolve which version to serve, and
310310
attaches one primary metric per template, scoped to the prompt. The feature flag is auto-created — do not
311-
create one separately. Launch the experiment with the launch tool when ready.
311+
create one separately. Launch the experiment with the launch tool when ready. The description accepts at
312+
most 3,000 characters and longer text is rejected, so keep the hypothesis summary short.
312313
ui_app: experiment
313314
response:
314315
include:

‎services/mcp/schema/generated-tool-definitions.json‎

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎services/mcp/schema/tool-definitions-all.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4430,7 +4430,7 @@
44304430
}
44314431
},
44324432
"experiment-create-from-prompt": {
4433-
"description": "Create a draft experiment that compares versions of an existing LLM prompt (managed with the llma-prompt tools). Pass the prompt's exact name (call llma-prompt-list to discover names), two or more of its version numbers (the first entry becomes the control variant), and one or more metric templates — call experiment-prompt-templates for the allowed template keys. Builds one variant per version, each carrying a feature flag payload with the prompt name and version so the SDK can resolve which version to serve, and attaches one primary metric per template, scoped to the prompt. The feature flag is auto-created — do not create one separately. Launch the experiment with the launch tool when ready.",
4433+
"description": "Create a draft experiment that compares versions of an existing LLM prompt (managed with the llma-prompt tools). Pass the prompt's exact name (call llma-prompt-list to discover names), two or more of its version numbers (the first entry becomes the control variant), and one or more metric templates — call experiment-prompt-templates for the allowed template keys. Builds one variant per version, each carrying a feature flag payload with the prompt name and version so the SDK can resolve which version to serve, and attaches one primary metric per template, scoped to the prompt. The feature flag is auto-created — do not create one separately. Launch the experiment with the launch tool when ready. The description accepts at most 3,000 characters and longer text is rejected, so keep the hypothesis summary short.",
44344434
"category": "Experiments",
44354435
"feature": "experiments",
44364436
"summary": "Create experiment from LLM prompt",

0 commit comments

Comments
 (0)