Skip to content

Add MultiheadAttention layer - #37

Merged
jessegrabowski merged 4 commits into
mainfrom
causal-self-attention
Jun 15, 2026
Merged

jessegrabowski merged 4 commits into
mainfrom
causal-self-attention

Conversation

@jessegrabowski

Copy link
Copy Markdown
Member

Also dispatch for jax/mlx

@codecov

codecov Bot commented Jun 15, 2026 •

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 81.39535% with 24 lines in your changes missing coverage. Please review.
✅ Project coverage is 91.27%. Comparing base (42b6d8f) to head (c59d7d1).

Files with missing lines Patch % Lines
pytensor_ml/dispatch/mlx/attention.py 0.00% 19 Missing ⚠️
pytensor_ml/attention.py 97.43% 2 Missing ⚠️
pytensor_ml/json_serialize.py 86.66% 2 Missing ⚠️
pytensor_ml/dispatch/mlx/__init__.py 0.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #37      +/-   ##
==========================================
- Coverage   92.35%   91.27%   -1.09%     
==========================================
  Files          26       31       +5     
  Lines        1191     1318     +127     
==========================================
+ Hits         1100     1203     +103     
- Misses         91      115      +24     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@jessegrabowski
jessegrabowski merged commit 114de47 into main Jun 15, 2026
4 of 6 checks passed
@jessegrabowski
jessegrabowski deleted the causal-self-attention branch June 15, 2026 01:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant