Skip to content

Commit f4de49a

Browse files
Update 2020-08-08-efficient-pytorch.md
1 parent aaa013c commit f4de49a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

_posts/2020-08-08-efficient-pytorch.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ The WebDataset library is a complete solution for working with large datasets an
4040

4141
The use of sharded, sequentially readable formats is essential for very large datasets. In addition, it has benefits in many other environments. WebDataset provides a solution that scales well from small problems on a desktop machine to very large deep learning problems in clusters or in the cloud. The following table summarizes some of the benefits in different environments.
4242

43-
43+
{:.table.table-striped.table-bordered}
4444
| Environment | Benefits of WebDataset |
4545
| ------------- | ------------- |
4646
| Local Cluster with AIStore | AIStore can be deployed easily as K8s containers and offers linear scalability and near 100% utilization of network and I/O bandwidth. Suitable for petascale deep learning. |

0 commit comments

Comments
 (0)