Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conda环境和下载pip包(torch)在8GB A100上很慢 #1788

Open
realharryhero opened this issue Aug 27, 2024 · 0 comments
Open

Conda环境和下载pip包(torch)在8GB A100上很慢 #1788

realharryhero opened this issue Aug 27, 2024 · 0 comments

Comments

@realharryhero
Copy link

realharryhero commented Aug 27, 2024

Hello,

In 1.2. 基础关卡, 第 2 关 (the demo which gives 30% A100 computing access), it takes a very long time to set up the "demo" conda environment (approximately 5 minutes); when I install a pip package it takes 25 minutes, for 30 minutes in total.

Mainly, the issue is installing the packages; downloading works okay but when installing the collected packages it takes quite a long time.

If creating the demo conda environment takes time due to the small amount of CPU resources in the virtual machine, maybe it would be a good idea to do either or both of two things:

  1. Tell learners in advance to partition some of their time specifically to only download the conda environment and LLM, or
  2. Create the demo conda environment on all the 10% A100 machines (which should be possible as the download size is ~5 GB, while the total memory available to users is ~40 GB.)

Do you think this a good idea? Thank you very much!

@realharryhero realharryhero changed the title Conda environment and downloading pip packages (torch) is slow on 10% A100 Conda环境和下载pip包(torch)在8GB A100上很慢 Aug 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant