Skip to content
MLX

[executorch][cuda] Add a batched-sequence CUDA KV cache #5873

Sign in to view logs

[executorch][cuda] Add a batched-sequence CUDA KV cache

[executorch][cuda] Add a batched-sequence CUDA KV cache #5873

Run time

Learn about OS pricing on GitHub Actions
Job Run time
CI run decision / decide
36s
test-mlx-voxtral-realtime / test-mlx-voxtral-realtime
23m 51s
test-mlx-qwen35-moe / test-mlx-qwen35-moe
13m 40s
test-mlx-supertonic / test-mlx-supertonic
15m 41s
test-mlx-nemotron3-diarization-build / test-mlx-nemotron3-diarization-build
13m 18s
test-mlx / test-mlx
18m 52s
test-mlx-parakeet / test-mlx-parakeet
15m 41s
test-mlx-dflash / test-mlx-dflash
18m 57s
test-mlx-stories110m / test-mlx-stories110m
15m 21s
test-mlx-muse-glimmer-build / test-mlx-muse-glimmer-build
13m 44s
test-mlx-voxtral / test-mlx-voxtral
19m 15s
test-mlx-whisper / test-mlx-whisper
11m 47s
test-mlx-llm-offgraph (unsloth/Llama-3.2-1B-Instruct, llama-1b, llama3) / test-mlx-llm-offgraph-llama-1b
16m 26s
backend-tester (operators) / test-mlx-backend-operators
11m 54s
test-mlx-llm-offgraph (google/gemma-4-E2B-it, gemma4-e2b, gemma4) / test-mlx-llm-offgraph-gemma4-e2b
22m 51s
backend-tester (models) / test-mlx-backend-models
16m 36s
test-mlx-llm-offgraph (unsloth/gemma-3-1b-it, gemma3-1b, gemma) / test-mlx-llm-offgraph-gemma3-1b
16m 1s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, false, 4w) / test-mlx-llm-llama-1b-4w
14m 4s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, true, 4w) / test-mlx-llm-gemma3-1b-custom-4w
13m 25s
test-mlx-llm (google/gemma-4-E2B-it, gemma4-e2b, false, 4w) / test-mlx-llm-gemma4-e2b-4w
22m 5s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, false, nvfp4) / test-mlx-llm-gemma3-1b-nvfp4
13m 45s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, true, 4w) / test-mlx-llm-llama-1b-custom-4w
13m 21s
test-mlx-llm (google/gemma-4-E2B-it, gemma4-e2b, true, 4w) / test-mlx-llm-gemma4-e2b-custom-4w
20m 38s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, true, 4w) / test-mlx-llm-qwen3-0.6b-custom-4w
13m 5s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, false, nvfp4) / test-mlx-llm-llama-1b-nvfp4
13m 15s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, true, nvfp4) / test-mlx-llm-llama-1b-custom-nvfp4
13m 1s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, false, 4w) / test-mlx-llm-gemma3-1b-4w
14m 29s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, true, nvfp4) / test-mlx-llm-qwen3-0.6b-custom-nvfp4
14m 26s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, false, 4w) / test-mlx-llm-qwen3-0.6b-4w
11m 58s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, false, nvfp4) / test-mlx-llm-qwen3-0.6b-nvfp4
13m 32s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, true, nvfp4) / test-mlx-llm-gemma3-1b-custom-nvfp4
13m 50s
7h 49m 25s