Repository navigation

feat(dpo): support SimPO reference-free preference optimization with target margin - #1699

Open

hsusul wants to merge 3 commits into

areal-project:mainfrom

hsusul:feat/simpo-preference-optimization

Open

feat(dpo): support SimPO reference-free preference optimization with target margin#1699
hsusul wants to merge 3 commits into
areal-project:mainfrom
hsusul:feat/simpo-preference-optimization

Commits on Sep 10, 2026
- feat(dpo): support SimPO reference-free preference optimization with target margin
  hsusul
  committed
  690306a
Commits on Oct 19, 2026
- fix(dpo): skip reference model for reference-free SimPO
  hsusul
  committed
  906c59b
- Merge remote-tracking branch 'upstream/main' into feat/simpo-preference-optimization
  hsusul
  committed
  6e2b011