Skip to content

Exploring Quantization Backends in Diffusers #2852

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 20 commits into from
May 21, 2025
Merged

Exploring Quantization Backends in Diffusers #2852

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
36f8968
init
DerekLiu35 May 13, 2025
a30e939
Apply suggestions from code review
DerekLiu35 May 15, 2025
7a3bbd4
turn images into tables
DerekLiu35 May 15, 2025
5c0b8cf
apply more suggestion from code review
DerekLiu35 May 15, 2025
198462e
update thumbnail
DerekLiu35 May 15, 2025
53fb11f
update thumbnail
DerekLiu35 May 18, 2025
305a063
typo
DerekLiu35 May 18, 2025
a403eba
apply suggestions from code review
DerekLiu35 May 19, 2025
b530e23
proofread
DerekLiu35 May 19, 2025
9bffa09
apply suggestions from code review
DerekLiu35 May 20, 2025
0b53cb1
add torchao INT4 example
DerekLiu35 May 20, 2025
91ca179
fix _blog.yml
DerekLiu35 May 20, 2025
3b06725
explain other ways to reduce memory usage
DerekLiu35 May 20, 2025
22afb0f
add more benchmark tables
DerekLiu35 May 21, 2025
66c957f
update blog.yml
DerekLiu35 May 21, 2025
23e66dd
fix bnb + `enable_model_cpu_offload` results
DerekLiu35 May 21, 2025
d008513
update _blog.yml
DerekLiu35 May 21, 2025
f7ba202
fix _blog.yml
DerekLiu35 May 21, 2025
fe3af19
fix _blog.yml
DerekLiu35 May 21, 2025
1ca534f
proofread
DerekLiu35 May 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 12 additions & 1 deletion _blog.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6028,4 +6028,15 @@
- nanovlm
- research
- community
- open
- open

- local: diffusers-quantization
title: "Exploring Quantization Backends in Diffusers"
thumbnail: /blog/assets/diffusers-quantization/thumbnail.png
author: derekl35
date: May 21, 2025
tags:
- guide
- diffusers
- quantization
- flux
Binary file added assets/diffusers-quantization/thumbnail.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading