Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
janhilgard
/
vllm-mlx
Public
forked from
waybarrios/vllm-mlx
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Actions: janhilgard/vllm-mlx
Actions
All workflows
Workflows
CI
CI
Show more workflows...
Management
Caches
All workflows
All workflows
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Showing runs from all workflows
will be ignored since log searching is not yet available
27 workflow runs
27 workflow runs
Workflow
Filter by Workflow
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching workflows.
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
feat: live inference KV cache quantization with asymmetric K/V bits
CI
#27:
Commit
9dce02c
pushed by
janhilgard
2m 28s
main
main
2m 28s
View workflow file
split summarize_workload_results into per-case helper (#519)
CI
#26:
Commit
0140ae0
pushed by
janhilgard
2m 23s
main
main
2m 23s
View workflow file
fix: add missing _eval_prompt_cache and PrefillAbortedError definitions
CI
#25:
Commit
011a0af
pushed by
janhilgard
1m 28s
main
main
1m 28s
View workflow file
feat: add reasoning parser support to Anthropic Messages API
CI
#24:
Commit
e5d0052
pushed by
janhilgard
1m 17s
main
main
1m 17s
View workflow file
fix: run MLLM prefill in thread executor to keep event loop responsive
CI
#23:
Commit
8b9bc86
pushed by
janhilgard
1m 22s
main
main
1m 22s
View workflow file
Fix RotatingKVCache merge crash on long prompts (>sliding_window)
CI
#22:
Commit
2d2d516
pushed by
janhilgard
1m 4s
main
main
1m 4s
View workflow file
Add per-request status info for MLLM scheduler
CI
#21:
Commit
ccee11b
pushed by
janhilgard
1m 8s
main
main
1m 8s
View workflow file
style: run black on test_gemma4_parser.py and qwen3_5_mtp.py
CI
#20:
Commit
c2d6b04
pushed by
janhilgard
1m 25s
main
main
1m 25s
View workflow file
fix: remove unused imports and extraneous f-string prefixes (lint)
CI
#19:
Commit
06fb183
pushed by
janhilgard
1m 2s
main
main
1m 2s
View workflow file
Add Gemma 4 tool call parser (from PR #254)
CI
#18:
Commit
b94fbae
pushed by
janhilgard
1m 21s
main
main
1m 21s
View workflow file
style: Run black on simple.py
CI
#17:
Commit
4d2b026
pushed by
janhilgard
1m 3s
main
main
1m 3s
View workflow file
fix: Update Qwen3 parser tests to match fork reasoning behavior
CI
#16:
Commit
e12a1b7
pushed by
janhilgard
59s
main
main
59s
View workflow file
fix: Remove duplicate --mllm argparse definition
CI
#15:
Commit
6b543d1
pushed by
janhilgard
1m 13s
main
main
1m 13s
View workflow file
Merge remote-tracking branch 'origin/main' into merge/upstream-to-fork
CI
#14:
Commit
1d0907c
pushed by
janhilgard
1m 16s
main
main
1m 16s
View workflow file
fix: replace hard prefill token limit with warning
CI
#13:
Commit
fc34b87
pushed by
janhilgard
1m 1s
main
main
1m 1s
View workflow file
fix: enable_thinking for reasoning models + MLLM stats promotion
CI
#12:
Commit
8b5cfe7
pushed by
janhilgard
1m 18s
main
main
1m 18s
View workflow file
fix: MLLM image processing — exclude_none for Jinja template, error h…
CI
#11:
Commit
310246d
pushed by
janhilgard
1m 5s
main
main
1m 5s
View workflow file
feat: patch Qwen3.5 attention for BatchKVCache compatibility
CI
#10:
Commit
bf78650
pushed by
janhilgard
1m 20s
main
main
1m 20s
View workflow file
feat: Support hybrid cache (ArraysCache+KVCache) in MLLM batching
CI
#9:
Commit
8eb783f
pushed by
janhilgard
1m 30s
main
main
1m 30s
View workflow file
style: black formatting
CI
#8:
Commit
d27c5ce
pushed by
janhilgard
1m 19s
main
main
1m 19s
View workflow file
fix: Remove unused import and f-string prefix (lint)
CI
#7:
Commit
cfcf32a
pushed by
janhilgard
1m 16s
main
main
1m 16s
View workflow file
feat: Qwen3.5 VLM loading, streaming detokenizer, tool markup stripping
CI
#6:
Commit
476f717
pushed by
janhilgard
1m 21s
main
main
1m 21s
View workflow file
Merge upstream main (PR #53: GPT-OSS reasoning parser)
CI
#5:
Commit
ae35736
pushed by
janhilgard
1m 23s
main
main
1m 23s
View workflow file
Merge branch 'main' of https://github.com/janhilgard/vllm-mlx
CI
#4:
Commit
cac39be
pushed by
janhilgard
3m 54s
main
main
3m 54s
View workflow file
fix: Clear stale MTP state between requests to prevent generation hang
CI
#3:
Commit
a18684b
pushed by
janhilgard
1m 7s
main
main
1m 7s
View workflow file
Previous
1
2
Next
You can’t perform that action at this time.