Skip to content

Conversation

ajrasane
Copy link
Contributor

What does this PR do?

Type of change: ? new example

Overview:
Added an example to run diffusion models using auto deploy
This example performs the following optimizations:

  1. torch.export()
  2. torch.compile()
  3. creating cudagraphs

Usage

python diffusion_autodeploy.py (generate an image with the default prompt for the BF16 model)
python diffusion_autodeploy.py --restore_from ./flux_dev_fp8.pt (generate image using modelopt quantized fp8 checkpoint)

Testing

In progress

Before your PR is "Ready for review"

  • Make sure you read and follow Contributor guidelines and your commits are signed.
  • Is this change backward compatible?: Yes/No
  • Did you write any new necessary tests?: Yes/No
  • Did you add or update any necessary documentation?: Yes/No
  • Did you update Changelog?: Yes/No

Additional Information

@ajrasane ajrasane self-assigned this Oct 16, 2025
Copy link

copy-pr-bot bot commented Oct 16, 2025

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

Copy link

coderabbitai bot commented Oct 16, 2025

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch ajrasane/diffusion_autodeploy

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@ajrasane ajrasane requested review from cjluo-nv and i-riyad October 16, 2025 22:06
Copy link

codecov bot commented Oct 16, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 73.38%. Comparing base (718fd9e) to head (2c7e6e4).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #443   +/-   ##
=======================================
  Coverage   73.37%   73.38%           
=======================================
  Files         180      180           
  Lines       17934    17934           
=======================================
+ Hits        13159    13160    +1     
+ Misses       4775     4774    -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant