Skip to content

Commit 1acbfc7

Browse files
author
Svetlana Karslioglu
authored
Merge branch 'main' into main
2 parents b3f07ce + 2bdd846 commit 1acbfc7

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

intermediate_source/FSDP_adavnced_tutorial.rst

+3-3
Original file line numberDiff line numberDiff line change
@@ -75,7 +75,7 @@ highlight different available features in FSDP that are helpful for training
7575
large scale model above 3B parameters. Also, we cover specific features for
7676
Transformer based models. The code for this tutorial is available in `Pytorch
7777
Examples
78-
<https://github.com/HamidShojanazeri/examples/tree/FSDP_example/FSDP/>`__.
78+
<https://github.com/HamidShojanazeri/examples/tree/FSDP_example/distributed/FSDP/>`__.
7979

8080

8181
*Setup*
@@ -97,13 +97,13 @@ Please create a `data` folder, download the WikiHow dataset from `wikihowAll.csv
9797
`wikihowSep.cs <https://ucsb.app.box.com/s/7yq601ijl1lzvlfu4rjdbbxforzd2oag>`__,
9898
and place them in the `data` folder. We will use the wikihow dataset from
9999
`summarization_dataset
100-
<https://github.com/HamidShojanazeri/examples/blob/FSDP_example/FSDP/summarization_dataset.py>`__.
100+
<https://github.com/HamidShojanazeri/examples/blob/FSDP_example/distributed/FSDP/summarization_dataset.py>`__.
101101

102102
Next, we add the following code snippets to a Python script “T5_training.py”.
103103

104104
.. note::
105105
The full source code for this tutorial is available in `PyTorch examples
106-
<https://github.com/HamidShojanazeri/examples/tree/FSDP_example/FSDP>`__.
106+
<https://github.com/HamidShojanazeri/examples/tree/FSDP_example/distributed/FSDP>`__.
107107

108108
1.3 Import necessary packages:
109109

0 commit comments

Comments
 (0)