Skip to content

Conversation

ManfeiBai
Copy link
Collaborator

No description provided.

@ManfeiBai ManfeiBai requested a review from miladm November 7, 2023 00:31
`example_text_completion.py` can also be ran on GPUs with XLA:GPU without quantization. To do that, you need different wheels than the above such
that you have XLA:GPU support. Please refer to [pytorch/xla](https://github.com/pytorch/xla#wheel) repo to download
a suitable GPU nightly wheel for your environment.
a suitable GPU nightly at 2023/04/22 wheel for your environment.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why are we using such an old whl @ManfeiBai?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

newest nightly wheel has issue of !info.content.empty(), debugging locally now, and 2023/04/22 wheel could pass

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants