mirror of
https://github.com/seaweedfs/seaweedfs.git
synced 2026-10-08 07:17:48 +02:00
move
1 parent
674f0efdfb
commit
489d2e4f24
2 files changed
+2
-2
No files matched your search
@@ -1,4 +1,4 @@
|
||||
# Peer Chunk Sharing Between weed mount Clients
|
||||
# P2P reading in weed mount
|
||||
|
||||
When a fleet of GPU hosts loads the same model file through `weed mount`, every client pulls bytes from the volume tier. Even with [`fs.distributeChunks`](Distributing-AI-Model-Files-for-Multi-GPU-Loading) spreading the chunks evenly across every volume server, the volume tier's total NIC bandwidth caps how fast the read burst can complete. Peer chunk sharing lets mounts fetch chunks from each other instead, so after the first wave seeds a handful of mounts, subsequent reads fan out across the whole fleet.
|
||||
|
||||
+1
-1
@@ -60,6 +60,7 @@
|
||||
* [[FIO benchmark]]
|
||||
* [[fstab and systemd mount]]
|
||||
* [[POSIX Compliance]]
|
||||
* [[P2P reading in weed mount]]
|
||||
|
||||
### [[WebDAV]]
|
||||
|
||||
@@ -132,7 +133,6 @@
|
||||
### Machine Learning
|
||||
* [[TensorFlow with SeaweedFS]]
|
||||
* [[Distributing AI Model Files for Multi-GPU Loading]]
|
||||
* [[Peer Chunk Sharing Between weed mount Clients]]
|
||||
|
||||
### HDFS
|
||||
* [[Hadoop Compatible File System]]
|
||||
|
||||
Reference in new issue
Block a user