Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

probability density for each index in the codebook #41

Open
goforher opened this issue Oct 12, 2024 · 1 comment
Open

probability density for each index in the codebook #41

goforher opened this issue Oct 12, 2024 · 1 comment

Comments

@goforher
Copy link

In Section 3.2 of the paper, you presented the probability density for each index in the codebook. Could you explain how this was achieved? Also, during this process, were you training with 40 Tokens/s or 75 Tokens/s?
In the experiments section, you mentioned: "We train WavTokenizer-small up to 1 million iterations, with 500 thousand iterations allocated to both the generator and discriminator on 16 NVIDIA A800 80G GPUs." Could you share the GPU utilization during training? If I were to train with a single 40GB GPU, what would the estimated training time be?

@jishengpeng
Copy link
Owner

jishengpeng commented Oct 18, 2024

In Section 3.2 of the paper, you presented the probability density for each index in the codebook. Could you explain how this was achieved? Also, during this process, were you training with 40 Tokens/s or 75 Tokens/s? In the experiments section, you mentioned: "We train WavTokenizer-small up to 1 million iterations, with 500 thousand iterations allocated to both the generator and discriminator on 16 NVIDIA A800 80G GPUs." Could you share the GPU utilization during training? If I were to train with a single 40GB GPU, what would the estimated training time be?

In the 75-token version, we calculated the frequency of each codebook entry to derive the probability density. The GPU utilization was close to 100%, and training the LibriTTS version on a single 40GB GPU may take several weeks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants