docs(miner): inventory real-world contribution eligibility signals for the AMS profile#6948
Conversation
…r the AMS profile (JSONbored#6794) Audits label taxonomies + contribution/PR-template/agent docs across 10 diverse public repos (JSONbored gate-enabled, large OSS with divergent norms, an agent-docs- only repo, and a no-docs repo) from the live GitHub API, so JSONbored#6795's ContributionProfile schema is grounded in evidence rather than assumption. Key findings: no universal eligibility label (good first issue/help wanted absent from rust/deno/kubernetes, which use their own taxonomies); label-description coverage varies 3/17..99/100 so the description can't be relied on but can't be ignored; CONTRIBUTING is often a signpost not the rules (react 208B, k8s 525B); the linked-issue requirement is loopover-local, not an ecosystem norm; and AGENTS.md/CLAUDE.md is the most consistent non-label signal (6/10). Research/docs only. Closes JSONbored#6794
|
Superagent didn't find any vulnerabilities or security issues in this PR. |
|
Tip ✅ LoopOver review result - approve/merge recommendedReview updated: 2026-07-17 17:12:21 UTC
Review summary Nits — 6 non-blocking
Decision drivers
Context & advisory signals — never blocks the verdict
Review context
Contributor next steps
Signal definitions
🧪 Chat with LoopOverAsk LoopOver a question about this PR directly in a comment — grounded only in the same cached, public-safe facts shown above, never a new claim.
Full command reference: https://loopover.ai/docs/loopover-commands 🧪 Experimental — new and may change. 🟩 Safe / merged · 🟦 Advisory · 🟨 Held for review · 🟥 Blocked / closed 💰 Earn for open-source contributions like this. Gittensor lets GitHub contributors earn for the work they already do — register to start earning →. Checked by LoopOver, a quiet PR intelligence layer for OSS maintainers.
|
Summary
The
ContributionProfileschema (#6795) must be grounded in what real repos actually expose, not an assumption. This audits 10 diverse public repos from the live GitHub API and writes the inventory topackages/loopover-miner/docs/ams-contribution-signal-inventory.md, following theams-storage-abstraction-research.md/ams-auth-identity-research.mdprecedent in that same directory.Research and docs only — no code, no schema, no
discoverwiring, exactly as the issue scopes.The sample
Two JSONbored gate-enabled repos, six large OSS projects chosen for divergent contribution norms (react, rust, svelte, deno, tailwindcss, kubernetes), one repo with agent docs but no human contribution docs (
sure-aio), and one with no contribution docs at all (sindresorhus/slugify— the negative case the issue explicitly asks for).What the evidence says — and why it changes the schema
Every figure was read from
GET /repos/{owner}/{repo}/labelsand.../contents/{path}on 2026-07-17, not from memory. Four findings, each with a direct schema implication:good first issue/help wantedare present in only 6 of 10. The three largest by contributor activity — rust, deno, kubernetes — use their own taxonomies (rust:E-easy/E-medium/E-hard). A fixed-name matcher silently returns "no eligible issues" on exactly those repos.E-easyreads "…Good first issue.").CONTRIBUTING.mdis often a signpost. react's is 208 bytes, kubernetes' 525 — both just links to an external guide AMS can't read. "Has CONTRIBUTING.md" is a near-worthless presence check.CONTRIBUTING.md: loopover 8 mentions, react/rust/kubernetes 0. Modeling it as a core profile field would encode our own gate's norm as if it were general — a mistake this doc exists to prevent the next issue from making.Plus one genuinely surprising result:
AGENTS.md/CLAUDE.mdis the most consistent non-label signal (6/10, including react/deno/k8s/svelte), andsure-aiohas agent docs but noCONTRIBUTING— so extraction that treats human docs as primary and agent docs as fallback has the priority backwards.The doc closes with an explicit "what this means for #6795" section, so the schema-design issue can build against evidence rather than re-derive it.
Validation
docs:drift-check— ok (the doc adds no config/command surface).prettier --check— clean (Markdown formatting).gittensor:*label reward multipliers even though they were in the raw data.packages/loopover-miner/docs/); no code, so no coverage/CI-suite obligation; rebased on latestmain, no base conflict.Scope & safety
discoverchange — the implementation sub-issues (AMS contribution-profile: design the ContributionProfile schema and caching shape #6795–AMS contribution-profile: wire eligibility filtering into discover #6798) build on this.site/,CNAME, orlovablechanges.Closes #6794