All pull requests

Pull requests

• fix(api): honor custom CA bundles for completions

  #4404·ningyixi opened Oct 17, 2026·

  ·
  2

• fix(scripts): migrate get_prompts.py to TaskManager

  #4403·JunyangLian opened Oct 17, 2026·

  ·

• test(sglang): cover generate API payloads and generation responses

  #4402·JunyangLian opened Oct 17, 2026·

  ·
  1

• test(models): exercise Mistral3 text adapter offline

  #4401·sonawaneutkarsh opened Oct 17, 2026·

  ·
  1

• Add serbeval: native Serbian grammar, morphology and orthography tasks

  #4400·djolex999 opened Oct 16, 2026·

  ·
  1

• Restore SGLang tokenizer identity and chat template metadata

  #4399·sdivyanshu90 opened Oct 16, 2026Contributor·

  ·
  1

  1

• Preserve vLLM thinking options from chat template arguments

  #4398·sdivyanshu90 opened Oct 16, 2026Contributor·

  ·
  1

  1

• Average Evalita NER F1 over its declared entity labels

  #4395·Afloat16 opened Oct 15, 2026·

  ·

• Count each Evalita lexical-substitution prediction once

  #4394·Afloat16 opened Oct 15, 2026·

  ·

• fix(caching): warn on unreadable cache entries instead of silent debug

  #4390·AUTHENSOR opened Oct 15, 2026·

  ·
  1

• feat(tasks): log execution of external task code at !function load

  #4389·AUTHENSOR opened Oct 15, 2026·

  ·
  1

• Honor bare xpu, hpu, and npu device names in HFLM

  #4388·sdivyanshu90 opened Oct 14, 2026Contributor·

  ·
  1

  1

• Exclude prompt tokens from Neuron generation stop criteria

  #4387·sdivyanshu90 opened Oct 14, 2026Contributor·

  ·
  1

  1

• fix(metrics): run the trailing partial chunk in bootstrap_stderr

  #4384·CJstate opened Oct 14, 2026·

  ·
  1

• Add SPaRC (spatial pathfinding puzzles)

  #4383·lkaesberg opened Oct 13, 2026·6 tasks done·

  ·

• fix(anthropic-chat): support current Claude models (sampling params, thinking blocks)

  #4382·pcbeingused333 opened Oct 13, 2026·

  ·
  1

• fix(afrobench): avoid doubled target_delimiter on MC prompts

  #4381·Parsiffall1 opened Oct 13, 2026·

  ·
  1

  1

• Fix flexible-extract regex matching digit-less tokens like $., $$, ...

  #4379·YashwanthNomula opened Oct 13, 2026·

  ·
  1

  2

• fix(hf): consolidate rolling likelihood progress bars

  #4378·bianyh opened Oct 13, 2026·

  ·
  1

• test(scripts): cover results-directory table generation

  #4377·bianyh opened Oct 13, 2026·

  ·
  1

• test(watsonx): cover credential validation

  #4376·mrhimanshu opened Oct 13, 2026·

  ·
  1

• Fix textsynth backend to read Instance.args; add test coverage (ref #1613) 

  #4374·MsBodavula opened Oct 13, 2026·

  ·
  1

• fix(gsm8k): keep the last digit in the CoT strict-match answer

  #4373·barkha1research-ai opened Oct 12, 2026·

  ·
  1

• Fix overlapping model arguments in LM factory configuration

  #4372·AaravMehta-07 opened Oct 12, 2026·

  ·
  1

• fix(tasks): use real newlines in arc_challenge_chat and jsonschema_bench prompts

  #4371·KardeniaPoyu opened Oct 12, 2026·

  ·
  1

  2