Hey! Quark's skills (quark-install and the LLM PTQ one) are federated into amd/skills via amd/skills#248, but skillscope checks aren't running on Quark's CI yet. Structural passed locally on v0.1.3, so this is mostly about wiring it up.
What we'd like:
- Add skillscope structural checks to Quark CI (internal is fine) so skill changes get caught early
- Behavioral evals assumin an API key or internal runner can be secured
- Fold in the follow-ups from the review: use
files_exist / logs_contain graders, add a case for the native-wheel install path, and link references/example-fp8-qwen3-8b.md from SKILL.md
No rush given the holiday, just want a plan to land this sooner rather than later. Thanks!
cc @amd-zhaofeng
Hey! Quark's skills (
quark-installand the LLM PTQ one) are federated into amd/skills via amd/skills#248, but skillscope checks aren't running on Quark's CI yet. Structural passed locally on v0.1.3, so this is mostly about wiring it up.What we'd like:
files_exist/logs_containgraders, add a case for the native-wheel install path, and linkreferences/example-fp8-qwen3-8b.mdfrom SKILL.mdNo rush given the holiday, just want a plan to land this sooner rather than later. Thanks!
cc @amd-zhaofeng