Skip to content
CI

feat(llma): add typed offline evaluations SDK #3487

Sign in to view logs

feat(llma): add typed offline evaluations SDK

feat(llma): add typed offline evaluations SDK #3487

Triggered via pull request October 2, 2026 16:04
@Radu-RaiceaRadu-Raicea
opened #1005
feat/llma-offline-evaluations
Status Success
Total duration 6m 19s
Artifacts –

ci.yml

on: pull_request
Ruff format
20s
Ruff format
Ruff lint
23s
Ruff lint
Mypy
32s
Mypy
Public API snapshot
22s
Public API snapshot
Strict type smoke
25s
Strict type smoke
Package build
24s
Package build
Targeted mutation tests
8s
Targeted mutation tests
Django 5 integration tests
17s
Django 5 integration tests
Matrix: import-check
Matrix: openfeature-provider
Matrix: tests-mcp
Matrix: tests
Fit to window
Zoom out
Zoom in

Annotations

14 warnings and 27 notices
Ruff format
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.11.11-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
Public API snapshot
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.11.11-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
MCP SDK v1 (Python 3.10)
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.10.21-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
OpenFeature provider Python 3.12
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.12.14-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
Package build
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.11.11-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
OpenFeature provider Python 3.10
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.10.21-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
Mypy
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.11.11-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
Python 3.11 tests
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.11.16-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
Python 3.10 tests
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.10.21-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
Python 3.12 tests
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.12.14-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
Python 3.13 tests
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.13.15-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
MCP SDK v2 (Python 3.14)
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.14.7-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
MCP SDK v1 (Python 3.14)
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.14.7-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
Python 3.14 tests
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-3.14.7-7e349767c46e0bc9db497891dcc30ab06b59a10bb25f41be635de7b47c0e5110, another job may be creating this cache.
Targeted mutation tests
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Python 3.11 import check
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Python 3.13 import check
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Python 3.14 import check
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Python 3.12 import check
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Python 3.10 import check
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Django 5 integration tests
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
OpenFeature provider Python 3.11
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Ruff format
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Public API snapshot
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
MCP SDK v1 (Python 3.10)
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Ruff lint
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
OpenFeature provider Python 3.14
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
MCP SDK v2 (Python 3.10)
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
OpenFeature provider Python 3.12
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Package build
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
OpenFeature provider Python 3.13
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Strict type smoke
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
OpenFeature provider Python 3.10
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Mypy
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Python 3.11 tests
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Python 3.10 tests
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Python 3.12 tests
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Python 3.13 tests
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
MCP SDK v2 (Python 3.14)
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
MCP SDK v1 (Python 3.14)
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Python 3.14 tests
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"