Skip to content

feat(llama_cpp_et): add Baichuan2-7B-Chat causal-LM port - #184

Open
DarthCeltic wants to merge 2 commits into
aifoundry-org:mainfrom
DarthCeltic:port-baichuan2-7b
Open

feat(llama_cpp_et): add Baichuan2-7B-Chat causal-LM port#184
DarthCeltic wants to merge 2 commits into
aifoundry-org:mainfrom
DarthCeltic:port-baichuan2-7b

Conversation

@DarthCeltic

@DarthCeltic DarthCeltic commented Jul 25, 2026

Copy link
Copy Markdown
Contributor

Adds baichuan2_7b causal-LM port to llama.cpp-et. Resolves to plain llama arch (not a distinct execution family) -- no model-ports claim filed.

Uses the existing, unmodified completion-mode benchmark path, so it
gets full automated board scoring with zero changes to any protected
runner/reference file. GGUF sha256-pinned. Locally verified via
sysemu: loads cleanly with full 33/33 layer ET offload and a valid
1158-node compute graph; full decode timing is left to the real
self-hosted ET-SoC1 board runner (see recipe for detail).

Note: unlike other ports this session, this does not introduce a new
execution family -- the load log shows this checkpoint's GGUF
conversion resolves to the plain LLM_ARCH_LLAMA graph (Baichuan2-7B
is structurally a Llama-2 clone), not a distinct BaichuanForCausalLM
path. Documented explicitly in the recipe to keep the board-diversity
claim honest.
@DarthCeltic
DarthCeltic requested a review from AFOliveira as a code owner July 25, 2026 00:33
@github-actions github-actions Bot added track: model-ports Global approved model ports prize track: community Community support and ecosystem contributions labels Jul 25, 2026
@DarthCeltic

Copy link
Copy Markdown
Contributor Author

Same note as posted on the earlier PRs this session: per
docs/SUBMISSION_GUIDE.md's "most models ported" process, credit requires
a maintainer-registered identity_id (pinned upstream source, validation
contract, benchmark-config hash) on main before an implementation PR
can claim it, and that registration step itself earns no credit.

Could a maintainer register an identity for this model too?

  • baichuan2_7b: shaowenchen/baichuan2-7b-chat-gguf (community Q8_0
    GGUF of baichuan-inc/Baichuan2-7B-Chat), Baichuan2 Community License

Already wired into .github/ci/benchmark_config.json / artifacts.json
in this PR for general board scoring; happy to restructure into a
standalone ported_models/baichuan2_7b/ root plus the
ported_models/submissions/model_ports/baichuan2_7b.json claim file once
an identity exists, per the guide.

No urgency if this isn't the right moment -- just flagging the gap.

@AFOliveira

Copy link
Copy Markdown
Member

This currently registers a Baichuan benchmark but has no standalone port root or model-port claim. If it is intended for “Most Approved Model Ports”, please add the standalone root + claim, immutable artifact provenance, a committed deterministic oracle, and a successful full-offload ET-SoC1 run. Maintainers will then review/adopt the identity and contract.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

track: community Community support and ecosystem contributions track: model-ports Global approved model ports prize

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants