Want to try training Megatron-LM on your own?
An example training script can be found in Megatron-LM's GitHub repository.
A script to curate the openwebtext dataset can be found here.
-
Notifications
You must be signed in to change notification settings - Fork 1
Model Parallelism: Building and Deploying Large Neural Networks
License
boredengineering/model-parallelism-LNNs
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Model Parallelism: Building and Deploying Large Neural Networks
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published