Skip to content

reproduce oom#339

Draft
tianshuc0731 wants to merge 1 commit into
mainfrom
oom-test
Draft

reproduce oom#339
tianshuc0731 wants to merge 1 commit into
mainfrom
oom-test

Conversation

@tianshuc0731

@tianshuc0731 tianshuc0731 commented Aug 20, 2024

Copy link
Copy Markdown
Contributor

Simply throwing runtime exception at the end of load() function will trigger load() restart and GPU oom.
deployment logs: https://app.baseten.co/models/7qk7k59w/logs/32lxl2w

@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.


Tianshu Cheng seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants