You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-**Safety**: Scans for destructive commands, security risks, permission issues
216
+
-**Safety**: Scans for destructive commands, security risks, permission issues, and network containment (does the skill scope network access when using HTTP/APIs?)
Five new sub-criteria added in v1.1.0, inspired by [OpenAI's Skills + Shell + Compaction blog](https://developers.openai.com/blog/skills-shell-tips) and production data from Glean:
226
+
227
+
| Check | Category | Points | Why It Matters |
228
+
|-------|----------|--------|----------------|
229
+
|**Negative routing examples**| Scope | 2 | Skills that say when NOT to use them trigger ~20% more accurately (Glean data) |
230
+
|**Routing quality**| Scope | 1 | Descriptions with concrete tool names, I/O, and "use when" patterns route better than marketing copy |
231
+
|**Embedded templates**| Documentation | 2 | Real output templates inside the skill drove the biggest quality + latency gains in production |
232
+
|**Network containment**| Safety | 1 | Skills combining tools + open network access are a data exfiltration risk without scoping |
233
+
|**Artifact output spec**| Structure | 1 | Skills that define where outputs go create clean review boundaries |
234
+
223
235
### Grade Scale
224
236
225
237
| Grade | Score Range | Description |
@@ -261,6 +273,16 @@ my-skill/
261
273
262
274
Brief description of what this skill does and when to use it.
263
275
276
+
## When to Use
277
+
278
+
Use this skill when you need to [specific task] with [specific tools/inputs].
279
+
280
+
## When NOT to Use
281
+
282
+
Don't use this skill when:
283
+
- The task is [alternative scenario] — use [other skill] instead
284
+
- You need [different capability]
285
+
264
286
## Dependencies
265
287
266
288
- Tool 1: Installation instructions
@@ -273,6 +295,10 @@ Brief description of what this skill does and when to use it.
273
295
2. Specific commands to run
274
296
3. Expected outputs
275
297
298
+
## Output
299
+
300
+
Results are written to `./output/` as JSON files.
301
+
276
302
## Error Handling
277
303
278
304
- Common issues and solutions
@@ -281,6 +307,15 @@ Brief description of what this skill does and when to use it.
281
307
282
308
## Examples
283
309
310
+
### Example Output
311
+
312
+
```json
313
+
{
314
+
"status": "success",
315
+
"result": "Example of what the skill produces"
316
+
}
317
+
```
318
+
284
319
```bash
285
320
# Working example
286
321
./scripts/main.py --input "test data"
@@ -438,7 +473,7 @@ This project is licensed under the MIT License - see the [LICENSE](LICENSE) file
438
473
- Inspired by the need for quality assessment in AI agent skills
439
474
- Built for the OpenClaw and Claude Code communities
440
475
- Thanks to all contributors and skill creators
441
-
- Scoring methodology informed by software engineering best practices
476
+
- Scoring methodology informed by software engineering best practices and [OpenAI's production skill patterns](https://developers.openai.com/blog/skills-shell-tips)
0 commit comments