tahoe-lafs/trac-2024-07-25
2
0
Issues 1.1k Wiki Activity

[Imported from Trac: page Performance, version 3]

warner 2007-09-09 00:41:42 +00:00
parent b5e274edf2
commit 9e980fcf06
1 changed files with 7 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
Performance.md

@ -27,7 +27,8 @@ for 1000 files, 80ms each.
Doing the same uploads locally on my laptop (both the uploading node and the Doing the same uploads locally on my laptop (both the uploading node and the
storage nodes are local) takes 46s for 100 1kB files and 369s for 1000 files. storage nodes are local) takes 46s for 100 1kB files and 369s for 1000 files.
Small files seem to be limited by a per-file overhead. Large files are limited
by the link speed.
### Roundtrips ### Roundtrips
@ -54,6 +55,11 @@ Doing steps 2-8 in parallel (using the attached pipeline-sends.diff patch)
does indeed seem to bring the time-per-file down from 900ms to about 800ms, does indeed seem to bring the time-per-file down from 900ms to about 800ms,
although the results aren't conclusive. although the results aren't conclusive.
With the pipeline-sends patch, my uploads take A+B*size time, where A is 790ms
and B is 1/23.4kBps . 3.3/B gives the same speed that basic 'scp' gets, which
ought to be my upstream bandwidth. This suggests that the main limitation to
upload speed is the constant per-file overhead, and the FEC expansion factor.
## Storage Servers ## Storage Servers
ext3 (on tahoebs1) refuses to create more than 32000 subdirectories in a ext3 (on tahoebs1) refuses to create more than 32000 subdirectories in a