[Imported from Trac: page Performance, version 3]
parent
b5e274edf2
commit
9e980fcf06
|
@ -27,7 +27,8 @@ for 1000 files, 80ms each.
|
|||
Doing the same uploads locally on my laptop (both the uploading node and the
|
||||
storage nodes are local) takes 46s for 100 1kB files and 369s for 1000 files.
|
||||
|
||||
|
||||
Small files seem to be limited by a per-file overhead. Large files are limited
|
||||
by the link speed.
|
||||
|
||||
### Roundtrips
|
||||
|
||||
|
@ -54,6 +55,11 @@ Doing steps 2-8 in parallel (using the attached pipeline-sends.diff patch)
|
|||
does indeed seem to bring the time-per-file down from 900ms to about 800ms,
|
||||
although the results aren't conclusive.
|
||||
|
||||
With the pipeline-sends patch, my uploads take A+B*size time, where A is 790ms
|
||||
and B is 1/23.4kBps . 3.3/B gives the same speed that basic 'scp' gets, which
|
||||
ought to be my upstream bandwidth. This suggests that the main limitation to
|
||||
upload speed is the constant per-file overhead, and the FEC expansion factor.
|
||||
|
||||
## Storage Servers
|
||||
|
||||
ext3 (on tahoebs1) refuses to create more than 32000 subdirectories in a
|
||||
|
|
Loading…
Reference in a new issue