Skip to content

Commit

Permalink
Fix broken link to DeepSpeed Megatron fork (#2440)
Browse files Browse the repository at this point in the history
Co-authored-by: Lev Kurilenko <[email protected]>
  • Loading branch information
lekurile and lekurile authored Oct 21, 2022
1 parent b8fb9c3 commit 877a881
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/_tutorials/megatron.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ reduction_** from using DeepSpeed.

## Training GPT-2 with the Original Megatron-LM

We've copied the original model code from [Megatron-LM](https://github.com/NVIDIA/Megatron-LM) into DeepSpeed [Megatron-LM](https://github.com/microsoft/DeepSpeedExamples/tree/master/Megatron-LM-v1.1.5-ZeRO3) and made it available as a submodule. To download, execute:
We've copied the original model code from [Megatron-LM](https://github.com/NVIDIA/Megatron-LM) into DeepSpeed [Megatron-LM](https://github.com/microsoft/Megatron-DeepSpeed) and made it available as a submodule. To download, execute:
```bash
git submodule update --init --recursive
```
Expand Down

0 comments on commit 877a881

Please sign in to comment.