All issues

Search results

Document CodeProviders

Status: Open.

#485 In tbuckley/evals-pwa;

· tbuckley opened on Dec 29, 2025

A pipeline step should be able to call functions but not process their responses

Status: Open.

#473 In tbuckley/evals-pwa;

· tbuckley opened on Oct 27, 2025

In a pipeline step without a prompt, a function response is still sent to the provider and not the transform function

Status: Open.

#469 In tbuckley/evals-pwa;

· dstoc opened on Oct 27, 2025

Single-loop sessions

Status: Open.

#463 In tbuckley/evals-pwa;

· tbuckley opened on Oct 14, 2025

Support undefined/void output from transform

Status: Open.

#461 In tbuckley/evals-pwa;

· tbuckley opened on Oct 13, 2025

Only run transform after function calling completes

Status: Open.

#460 In tbuckley/evals-pwa;

· tbuckley opened on Oct 13, 2025

Allow prompt-level provider config overrides

Status: Open.

#442 In tbuckley/evals-pwa;

· tbuckley opened on Sep 17, 2025

Better ergonomics for how llm-rubric works when no provider is specified directly

Status: Open.

#439 In tbuckley/evals-pwa;

· dstoc opened on Sep 15, 2025

Support data streams as Provider input/output

Status: Open.

#421 In tbuckley/evals-pwa;

· tbuckley opened on Aug 18, 2025

When canceling a run, reset number of running tests

Status: Open.

#415 In tbuckley/evals-pwa;

· tbuckley opened on Aug 13, 2025

Use a hash instead of path for string values in handlebars

Status: Open.

#409 In tbuckley/evals-pwa;

· tbuckley opened on Jul 21, 2025

Use cache for llm-rubric too

Status: Open.

#406 In tbuckley/evals-pwa;

· tbuckley opened on Jul 17, 2025