Skip to content
ATOM Benchmark

nightly #16

Sign in to view logs

nightly

nightly #16

Triggered via schedule October 8, 2026 21:16
@devalshahamddevalshahamd
⁠ d69b063
main
Status Cancelled
Total duration 4h 59m 36s
Artifacts –

atom-benchmark.yaml

on: schedule
Build benchmark matrix
5s
Build benchmark matrix
Matrix: benchmark
Summarize benchmark result
Summarize benchmark result
Generate regression rerun matrix
Generate regression rerun matrix
Matrix: regression-rerun
Waiting for pending jobs
Collect regression traces
Collect regression traces
Profiler trace analysis
Profiler trace analysis
Fit to window
Zoom out
Zoom in

Annotations

194 errors and 1 notice
DeepSeek-V4-Pro 8k1k / c=8
repository invocation blocked
DeepSeek-V4-Pro 8k1k / c=4
repository invocation blocked
DeepSeek-V4-Pro MTP3 8k1k / c=8
repository invocation blocked
DeepSeek-V4-Pro MTP3 8k1k / c=4
repository invocation blocked
DeepSeek-V4-Pro TBO 8k1k / c=128
repository invocation blocked
DeepSeek-V4-Pro MTP3 8k1k / c=16
repository invocation blocked
DeepSeek-V4-Pro DPA 8k1k / c=64
repository invocation blocked
DeepSeek-V4-Pro 8k1k / c=16
repository invocation blocked
DeepSeek-V4-Pro DPA TBO 8k1k / c=256
repository invocation blocked
DeepSeek-V4-Pro DPA MTP3 8k1k / c=64
repository invocation blocked
DeepSeek-V4-Pro TBO 8k1k / c=64
repository invocation blocked
DeepSeek-V4-Pro DPA 8k1k / c=256
repository invocation blocked
DeepSeek-V4-Pro 8k1k / c=32
repository invocation blocked
DeepSeek-V4-Pro 8k1k / c=64
repository invocation blocked
DeepSeek-V4-Pro DPA 8k1k / c=128
repository invocation blocked
DeepSeek-V4-Pro TBO 8k1k / c=256
repository invocation blocked
DeepSeek-V4-Pro MTP3 8k1k / c=64
repository invocation blocked
DeepSeek-V4-Pro MTP3 8k1k / c=32
repository invocation blocked
DeepSeek-V4-Pro DPA DSpark 8k1k / c=64
repository invocation blocked
DeepSeek-V4-Pro DPA MTP3 8k1k / c=256
repository invocation blocked
DeepSeek-V4-Pro DPA TBO 8k1k / c=1024
repository invocation blocked
DeepSeek-V4-Pro EPLB r0 MegaMoE MegaMoE 8k1k / c=512
repository invocation blocked
DeepSeek-V4-Pro DPA DSpark 8k1k / c=128
repository invocation blocked
DeepSeek-V4-Pro MTP3 8k1k / c=256
repository invocation blocked
DeepSeek-V4-Pro 8k1k / c=256
repository invocation blocked
DeepSeek-V4-Pro 8k1k / c=128
repository invocation blocked
DeepSeek-V4-Pro DPA MTP3 8k1k / c=128
repository invocation blocked
DeepSeek-V4-Pro MTP3 8k1k / c=128
repository invocation blocked
DeepSeek-V4-Pro EPLB r0 MegaMoE MegaMoE 8k1k / c=4096
repository invocation blocked
DeepSeek-V4-Pro DPA MTP3 8k1k / c=512
repository invocation blocked
DeepSeek-V4-Pro DPA 8k1k / c=512
repository invocation blocked
DeepSeek-V4-Pro DPA TBO 8k1k / c=512
repository invocation blocked
DeepSeek-V4-Pro DPA DSpark 8k1k / c=256
repository invocation blocked
DeepSeek-V4-Pro DPA 8k1k / c=1024
repository invocation blocked
DeepSeek-V4-Pro DPA DSpark 8k1k / c=512
repository invocation blocked
DeepSeek-V4-Pro DPA MTP3 8k1k / c=1024
repository invocation blocked
DeepSeek-V4.1-Flash DSpark 8k1k / c=4
repository invocation blocked
DeepSeek-R1-0528-MXFP4 MTP3 8k1k / c=4
repository invocation blocked
DeepSeek-R1-0528-MXFP4 8k1k / c=4
repository invocation blocked
DeepSeek-V4.1-Flash DSpark 8k1k / c=8
repository invocation blocked
DeepSeek-R1-0528-MXFP4 MTP3 8k1k / c=8
repository invocation blocked
GLM-5.2-FP8 8k1k / c=4
repository invocation blocked
DeepSeek-V4.1-Flash DSpark 8k1k / c=16
repository invocation blocked
DeepSeek-V4.1-Flash DSpark 8k1k / c=64
repository invocation blocked
DeepSeek-R1-0528-MXFP4 8k1k / c=8
repository invocation blocked
DeepSeek-R1-0528-MXFP4 8k1k / c=64
repository invocation blocked
DeepSeek-R1-0528-MXFP4 8k1k / c=16
repository invocation blocked
DeepSeek-R1-0528-MXFP4 MTP3 8k1k / c=32
repository invocation blocked
DeepSeek-R1-0528-MXFP4 8k1k / c=32
repository invocation blocked
DeepSeek-R1-0528-MXFP4 MTP3 8k1k / c=16
repository invocation blocked
DeepSeek-R1-0528-MXFP4 8k1k / c=128
repository invocation blocked
GLM-5.2-FP8 MTP3 8k1k / c=8
repository invocation blocked
GLM-5.2-FP8 8k1k / c=8
repository invocation blocked
GLM-5.2-FP8 MTP3 8k1k / c=4
repository invocation blocked
GLM-5.2-FP8 8k1k / c=16
repository invocation blocked
GLM-5.2-MXFP4 8k1k / c=8
repository invocation blocked
DeepSeek-V4.1-Flash DSpark 8k1k / c=128
repository invocation blocked
GLM-5.2-MXFP4 8k1k / c=4
repository invocation blocked
GLM-5.2-MXFP4 8k1k / c=16
repository invocation blocked
DeepSeek-V4.1-Flash DSpark 8k1k / c=32
repository invocation blocked
GLM-5.2-MXFP4 MTP3 8k1k / c=4
repository invocation blocked
GLM-5.2-FP8 MTP3 8k1k / c=16
repository invocation blocked
GLM-5.2-FP8 8k1k / c=32
repository invocation blocked
gpt-oss-120b 8k1k / c=4
repository invocation blocked
GLM-5.2-FP8 MTP3 8k1k / c=32
repository invocation blocked
gpt-oss-120b 8k1k / c=8
repository invocation blocked
DeepSeek-R1-0528-MXFP4 MTP3 8k1k / c=128
repository invocation blocked
DeepSeek-V4.1-Flash DSpark 8k1k / c=256
repository invocation blocked
DeepSeek-R1-0528-MXFP4 MTP3 8k1k / c=64
repository invocation blocked
GLM-5.2-FP8 MTP3 8k1k / c=64
repository invocation blocked
GLM-5.2-MXFP4 MTP3 8k1k / c=8
repository invocation blocked
DeepSeek-R1-0528-MXFP4 8k1k / c=256
repository invocation blocked
Kimi-K3 DSpark 8k1k / c=4
repository invocation blocked
gpt-oss-120b 8k1k / c=32
repository invocation blocked
GLM-5.2-FP8 8k1k / c=64
repository invocation blocked
GLM-5.2-FP8 8k1k / c=128
repository invocation blocked
gpt-oss-120b 8k1k / c=16
repository invocation blocked
GLM-5.2-MXFP4 MTP3 8k1k / c=16
repository invocation blocked
GLM-5.2-MXFP4 8k1k / c=64
repository invocation blocked
Kimi-K2.7-Code-MXFP4 8k1k / c=4
repository invocation blocked
GLM-5.2-MXFP4 MTP3 8k1k / c=32
repository invocation blocked
Kimi-K2.7-Code-MXFP4 8k1k / c=8
repository invocation blocked
Kimi-K3 8k1k / c=8
repository invocation blocked
Kimi-K3 8k1k / c=4
repository invocation blocked
GLM-5.2-FP8 8k1k / c=256
repository invocation blocked
GLM-5.2-MXFP4 8k1k / c=32
repository invocation blocked
MiniMax-M3-MXFP8 8k1k / c=4
repository invocation blocked
DeepSeek-R1-0528-MXFP4 MTP3 8k1k / c=256
repository invocation blocked
GLM-5.2-FP8 MTP3 8k1k / c=128
repository invocation blocked
Kimi-K3 DSpark 8k1k / c=8
repository invocation blocked
gpt-oss-120b 8k1k / c=64
repository invocation blocked
Kimi-K2.7-Code-MXFP4 8k1k / c=16
repository invocation blocked
GLM-5.2-MXFP4 8k1k / c=128
repository invocation blocked
GLM-5.2-FP8 MTP3 8k1k / c=256
repository invocation blocked
Kimi-K2.7-Code-MXFP4 8k1k / c=32
repository invocation blocked
MiniMax-M3-MXFP8 EAGLE3 8k1k / c=4
repository invocation blocked
GLM-5.2-MXFP4 MTP3 8k1k / c=64
repository invocation blocked
MiniMax-M3-MXFP8 8k1k / c=16
repository invocation blocked
GLM-5.2-MXFP4 MTP3 8k1k / c=256
repository invocation blocked
GLM-5.2-MXFP4 MTP3 8k1k / c=128
repository invocation blocked
Kimi-K3 8k1k / c=16
repository invocation blocked
Kimi-K3 8k1k / c=32
repository invocation blocked
MiniMax-M3-MXFP8 8k1k / c=8
repository invocation blocked
gpt-oss-120b 8k1k / c=128
repository invocation blocked
Kimi-K3 DSpark 8k1k / c=16
repository invocation blocked
GLM-5.2-MXFP4 8k1k / c=256
repository invocation blocked
Kimi-K2.7-Code-MXFP4 8k1k / c=64
repository invocation blocked
gpt-oss-120b 8k1k / c=256
repository invocation blocked
Kimi-K3 DSpark 8k1k / c=32
repository invocation blocked
Kimi-K2.7-Code-MXFP4 8k1k / c=128
repository invocation blocked
MiniMax-M3-MXFP8 EAGLE3 8k1k / c=8
repository invocation blocked
Kimi-K3 8k1k / c=64
repository invocation blocked
MiniMax-M3-MXFP4 8k1k / c=4
repository invocation blocked
MiniMax-M3-MXFP4 8k1k / c=8
repository invocation blocked
MiniMax-M3-MXFP4 EAGLE3 8k1k / c=4
repository invocation blocked
Kimi-K3 DSpark 8k1k / c=128
repository invocation blocked
MiniMax-M3-MXFP4 EAGLE3 8k1k / c=8
repository invocation blocked
Kimi-K3 DSpark 8k1k / c=64
repository invocation blocked
MiniMax-M3-MXFP8 EAGLE3 8k1k / c=16
repository invocation blocked
Kimi-K2.7-Code-MXFP4 8k1k / c=256
repository invocation blocked
MiniMax-M3-MXFP4 8k1k / c=16
repository invocation blocked
Kimi-K3 8k1k / c=256
repository invocation blocked
Kimi-K3 8k1k / c=128
repository invocation blocked
Qwen3.5-397B-A17B-FP8 8k1k / c=4
repository invocation blocked
MiniMax-M3-MXFP4 8k1k / c=32
repository invocation blocked
MiniMax-M3-MXFP8 8k1k / c=64
repository invocation blocked
MiniMax-M3-MXFP8 8k1k / c=32
repository invocation blocked
MiniMax-M3-MXFP4 8k1k / c=64
repository invocation blocked
MiniMax-M3-MXFP8 EAGLE3 8k1k / c=32
repository invocation blocked
MiniMax-M3-MXFP4 EAGLE3 8k1k / c=16
repository invocation blocked
Qwen3.5-397B-A17B-FP8 MTP3 8k1k / c=4
repository invocation blocked
Qwen3.5-397B-A17B-FP8 8k1k / c=8
repository invocation blocked
Qwen3.5-397B-A17B-MXFP4 8k1k / c=8
repository invocation blocked
Qwen3.5-397B-A17B-MXFP4 8k1k / c=4
repository invocation blocked
MiniMax-M3-MXFP8 8k1k / c=256
repository invocation blocked
MiniMax-M3-MXFP4 EAGLE3 8k1k / c=32
repository invocation blocked
MiniMax-M3-MXFP8 EAGLE3 8k1k / c=64
repository invocation blocked
MiniMax-M3-MXFP8 EAGLE3 8k1k / c=128
repository invocation blocked
Qwen3.5-397B-A17B-FP8 8k1k / c=16
repository invocation blocked
Qwen3.5-397B-A17B-FP8 MTP3 8k1k / c=8
repository invocation blocked
MiniMax-M3-MXFP4 8k1k / c=128
repository invocation blocked
Kimi-K3 DSpark 8k1k / c=256
repository invocation blocked
Llama-3.3-70B-Instruct-MXFP4 8k1k / c=4
repository invocation blocked
MiniMax-M3-MXFP4 EAGLE3 8k1k / c=64
repository invocation blocked
MiniMax-M3-MXFP8 EAGLE3 8k1k / c=256
repository invocation blocked
Qwen3.5-397B-A17B-FP8 MTP3 8k1k / c=16
repository invocation blocked
Llama-3.3-70B-Instruct-MXFP4 8k1k / c=8
repository invocation blocked
MiniMax-M3-MXFP4 EAGLE3 8k1k / c=128
repository invocation blocked
Qwen3.5-397B-A17B-FP8 8k1k / c=32
repository invocation blocked
MiniMax-M3-MXFP4 8k1k / c=256
repository invocation blocked
Llama-3.3-70B-Instruct-MXFP4 8k1k / c=16
repository invocation blocked
MiniMax-M3-MXFP8 8k1k / c=128
repository invocation blocked
Qwen3.5-397B-A17B-FP8 8k1k / c=64
repository invocation blocked
Qwen3.5-397B-A17B-MXFP4 8k1k / c=16
repository invocation blocked
MiniMax-M3-MXFP4 EAGLE3 8k1k / c=256
repository invocation blocked
Qwen3.5-397B-A17B-MXFP4 8k1k / c=32
repository invocation blocked
Qwen3.5-397B-A17B-FP8 MTP3 8k1k / c=32
repository invocation blocked
Qwen3.5-397B-A17B-MXFP4 8k1k / c=64
repository invocation blocked
Qwen3.5-397B-A17B-FP8 MTP3 8k1k / c=64
repository invocation blocked
Qwen3.5-397B-A17B-MXFP4 8k1k / c=256
repository invocation blocked
Qwen3.5-397B-A17B-FP8 8k1k / c=128
repository invocation blocked
Qwen3.5-397B-A17B-FP8 MTP3 8k1k / c=128
repository invocation blocked
Llama-3.3-70B-Instruct-MXFP4 8k1k / c=32
repository invocation blocked
Qwen3.5-397B-A17B-FP8 MTP3 8k1k / c=256
repository invocation blocked
Qwen3.5-397B-A17B-FP8 8k1k / c=256
repository invocation blocked
Llama-3.3-70B-Instruct-MXFP4 8k1k / c=64
repository invocation blocked
Llama-3.3-70B-Instruct-MXFP4 8k1k / c=128
repository invocation blocked
ATOM Benchmark
repository invocation blocked
Llama-3.3-70B-Instruct-MXFP4 8k1k / c=256
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
Qwen3.5-397B-A17B-MXFP4 8k1k / c=128
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
ATOM Benchmark
repository invocation blocked
Build benchmark matrix
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"