fix(runtime): guard launch_kv_append when head_dim exceeds 1024 #201

Open

opened

Summary

KV append uses blockDim=head_dim but CUDA limits blockDim.x to 1024.

Scope

runtime/csrc/cuda/kv_ops.cu

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests