Skip to content

add expo-skill-eval#87

Merged
Kudo merged 2 commits into
mainfrom
@kudo/expo-skill-eval
Jun 24, 2026
Merged

add expo-skill-eval#87
Kudo merged 2 commits into
mainfrom
@kudo/expo-skill-eval

Conversation

@Kudo

@Kudo Kudo commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

Why

add evals for our skills

How

inspired by the skill-creator that we can use a skill to run evals.

before running the eval, it will ask some questions

  • which skill to run the eval

  • what to verify: screenshots, lint results, or some custom criteria

  • what prompts to drive the evals, having some default e.g. build settings screen for expo-ui skill. you can also upload a screenshot to ask agent to generate code by the screenshot

  • which sdk version for the projects (will fetch the latest sdk version as default)

  • whether to test on expo-go or development builds

  • which platforms to test (android, ios, web)

  • for eval result, keep it on local or upload to claude shareable artifact

  • confirm question to run subagents on --dangerously-skip-permissions mode. otherwise subagents will ask many questions

  • confirm question to make sure the installed expo plugin is disabled. otherwise people may use the skills from marketplaces rather than the local developed

Test Plan

multiple runs on sonnet 4.6. some shared results that required expo org claude accounts to access

@Kudo Kudo marked this pull request as ready for review June 22, 2026 15:23
@Kudo Kudo requested review from davidmokos and zvadaadam June 22, 2026 15:24

@davidmokos davidmokos left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is super helpful for us. The questions is whether it's helpful for expo users and should be shipped with the rest of the skills?

Kudo commented Jun 23, 2026

Copy link
Copy Markdown
Contributor Author

The questions is whether it's helpful for expo users and should be shipped with the rest of the skills?

​that's not a scope currently. the skill is based on many assumptions and only works on macos host. if people really want to have the skill, they could copy the entire directory to their $HOME/.claude/skills.

@zvadaadam zvadaadam left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's merge it so we can start experimenting with it <3

I had some problems with expo go in this version but might be problem with my setup. I don't feel it's a blocker now.

@Kudo Kudo merged commit b5f13f8 into main Jun 24, 2026
1 check passed
@Kudo Kudo deleted the @kudo/expo-skill-eval branch June 24, 2026 13:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants