Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=hdd journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31862 min 0.001 ms max 10.934 ms avg 0.087 ms med 0.004 ms std 0.692 B lstat file cnt 29764 min 0.007 ms max 11.391 ms avg 0.064 ms med 0.022 ms std 0.451 C open file cnt 23472 min 0.014 ms max 0.306 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 23472 min 0.172 ms max 32.499 ms avg 0.633 ms med 0.281 ms std 1.440 E read rate 79.021 MB/s (data) 23.419 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3202 min 0.001 ms max 38.388 ms avg 0.511 ms med 0.004 ms std 3.048 B lstat file cnt 3001 min 0.007 ms max 52.942 ms avg 0.560 ms med 0.024 ms std 3.354 C open file cnt 2393 min 0.014 ms max 0.102 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 2393 min 0.178 ms max 114.359 ms avg 7.864 ms med 0.383 ms std 14.131 E read rate 7.954 MB/s (data) 2.144 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 158 min 0.037 ms max 36.556 ms avg 0.279 ms med 0.041 ms std 2.895 G wr 1st byte cnt 158 min 0.006 ms max 0.016 ms avg 0.007 ms med 0.007 ms std 0.001 H write close cnt 158 min 0.014 ms max 0.814 ms avg 0.024 ms med 0.018 ms std 0.063 I mkdir cnt 14 min 0.021 ms max 13506.857 ms avg 1005.752 ms med 0.031 ms std 3468.510 J write rate 0.283 MB/s (data) 0.282 MB/s (open + 1st byte + data + close) A read dir cnt 11256 min 0.001 ms max 42.777 ms avg 0.144 ms med 0.004 ms std 1.288 B lstat file cnt 10506 min 0.007 ms max 44.017 ms avg 0.119 ms med 0.022 ms std 1.044 C open file cnt 8261 min 0.014 ms max 0.270 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 8261 min 0.177 ms max 309.244 ms avg 3.321 ms med 0.300 ms std 19.079 E read rate 17.776 MB/s (data) 4.883 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=hdd journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31989 min 0.001 ms max 10.874 ms avg 0.087 ms med 0.004 ms std 0.690 B lstat file cnt 29879 min 0.007 ms max 16.567 ms avg 0.066 ms med 0.023 ms std 0.460 C open file cnt 23549 min 0.014 ms max 0.279 ms avg 0.021 ms med 0.021 ms std 0.011 D rd 1st byte cnt 23549 min 0.174 ms max 14.039 ms avg 0.631 ms med 0.280 ms std 1.424 E read rate 79.709 MB/s (data) 23.506 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3064 min 0.001 ms max 50.452 ms avg 0.567 ms med 0.004 ms std 3.283 B lstat file cnt 2871 min 0.007 ms max 43.454 ms avg 0.520 ms med 0.024 ms std 3.096 C open file cnt 2290 min 0.014 ms max 0.188 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 2290 min 0.183 ms max 153.150 ms avg 8.416 ms med 0.678 ms std 14.829 E read rate 8.048 MB/s (data) 2.056 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 207 min 0.037 ms max 1.596 ms avg 0.056 ms med 0.041 ms std 0.111 G wr 1st byte cnt 207 min 0.006 ms max 0.013 ms avg 0.007 ms med 0.007 ms std 0.001 H write close cnt 207 min 0.013 ms max 0.182 ms avg 0.020 ms med 0.018 ms std 0.016 I mkdir cnt 19 min 0.020 ms max 109.117 ms avg 28.889 ms med 0.057 ms std 38.064 J write rate 0.283 MB/s (data) 0.283 MB/s (open + 1st byte + data + close) A read dir cnt 11166 min 0.001 ms max 52.658 ms avg 0.178 ms med 0.004 ms std 1.666 B lstat file cnt 10419 min 0.007 ms max 39.428 ms avg 0.146 ms med 0.023 ms std 1.351 C open file cnt 8181 min 0.014 ms max 0.262 ms avg 0.021 ms med 0.018 ms std 0.013 D rd 1st byte cnt 8181 min 0.175 ms max 326.090 ms avg 3.181 ms med 0.301 ms std 18.234 E read rate 16.241 MB/s (data) 4.852 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=hdd journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31996 min 0.001 ms max 12.384 ms avg 0.087 ms med 0.004 ms std 0.688 B lstat file cnt 29886 min 0.007 ms max 16.494 ms avg 0.066 ms med 0.022 ms std 0.465 C open file cnt 23556 min 0.014 ms max 0.193 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 23556 min 0.172 ms max 32.487 ms avg 0.631 ms med 0.281 ms std 1.427 E read rate 79.738 MB/s (data) 23.507 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3080 min 0.001 ms max 58.296 ms avg 0.625 ms med 0.004 ms std 3.667 B lstat file cnt 2887 min 0.007 ms max 43.964 ms avg 0.622 ms med 0.024 ms std 3.501 C open file cnt 2307 min 0.014 ms max 0.156 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 2307 min 0.179 ms max 156.380 ms avg 8.012 ms med 0.469 ms std 14.158 E read rate 7.908 MB/s (data) 2.119 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 158 min 0.038 ms max 0.098 ms avg 0.043 ms med 0.041 ms std 0.009 G wr 1st byte cnt 158 min 0.006 ms max 0.015 ms avg 0.007 ms med 0.007 ms std 0.001 H write close cnt 158 min 0.014 ms max 0.047 ms avg 0.018 ms med 0.018 ms std 0.004 I mkdir cnt 14 min 0.023 ms max 7854.268 ms avg 627.448 ms med 0.442 ms std 2008.215 J write rate 0.283 MB/s (data) 0.283 MB/s (open + 1st byte + data + close) A read dir cnt 9571 min 0.001 ms max 211.511 ms avg 0.174 ms med 0.004 ms std 2.517 B lstat file cnt 8926 min 0.007 ms max 165.177 ms avg 0.143 ms med 0.022 ms std 2.002 C open file cnt 6993 min 0.014 ms max 0.282 ms avg 0.021 ms med 0.017 ms std 0.013 D rd 1st byte cnt 6993 min 0.177 ms max 326.752 ms avg 3.226 ms med 0.299 ms std 19.422 E read rate 18.816 MB/s (data) 5.002 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=hdd journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31957 min 0.001 ms max 20.218 ms avg 0.089 ms med 0.004 ms std 0.708 B lstat file cnt 29851 min 0.007 ms max 12.094 ms avg 0.066 ms med 0.023 ms std 0.457 C open file cnt 23529 min 0.014 ms max 0.297 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 23529 min 0.174 ms max 32.477 ms avg 0.629 ms med 0.277 ms std 1.430 E read rate 79.823 MB/s (data) 23.603 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 2857 min 0.001 ms max 42.896 ms avg 0.570 ms med 0.004 ms std 3.402 B lstat file cnt 2675 min 0.007 ms max 61.110 ms avg 0.612 ms med 0.025 ms std 3.439 C open file cnt 2128 min 0.015 ms max 0.105 ms avg 0.021 ms med 0.018 ms std 0.009 D rd 1st byte cnt 2128 min 0.184 ms max 177.683 ms avg 9.069 ms med 0.864 ms std 15.763 E read rate 7.674 MB/s (data) 1.957 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 252 min 0.037 ms max 14641.786 ms avg 58.149 ms med 0.042 ms std 920.511 G wr 1st byte cnt 252 min 0.006 ms max 0.108 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 252 min 0.013 ms max 224.221 ms avg 0.909 ms med 0.019 ms std 14.095 I mkdir cnt 24 min 0.024 ms max 4070.814 ms avg 212.284 ms med 0.035 ms std 809.510 J write rate 0.782 MB/s (data) 0.359 MB/s (open + 1st byte + data + close) A read dir cnt 10456 min 0.001 ms max 43.955 ms avg 0.163 ms med 0.004 ms std 1.423 B lstat file cnt 9752 min 0.007 ms max 65.500 ms avg 0.118 ms med 0.023 ms std 1.092 C open file cnt 7643 min 0.014 ms max 0.215 ms avg 0.022 ms med 0.018 ms std 0.012 D rd 1st byte cnt 7643 min 0.177 ms max 321.269 ms avg 3.502 ms med 0.301 ms std 19.577 E read rate 17.077 MB/s (data) 4.588 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=hdd journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30945 min 0.001 ms max 20.021 ms avg 0.086 ms med 0.004 ms std 0.694 B lstat file cnt 28905 min 0.007 ms max 12.276 ms avg 0.065 ms med 0.023 ms std 0.453 C open file cnt 22788 min 0.014 ms max 0.190 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 22788 min 0.166 ms max 32.442 ms avg 0.623 ms med 0.286 ms std 1.417 E read rate 69.037 MB/s (data) 22.721 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1781 min 0.001 ms max 81.477 ms avg 0.871 ms med 0.004 ms std 4.563 B lstat file cnt 1666 min 0.008 ms max 63.928 ms avg 0.909 ms med 0.025 ms std 4.398 C open file cnt 1323 min 0.015 ms max 0.138 ms avg 0.022 ms med 0.018 ms std 0.012 D rd 1st byte cnt 1323 min 0.177 ms max 71.060 ms avg 13.802 ms med 14.307 ms std 10.932 E read rate 4.150 MB/s (data) 1.248 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4252 min 0.036 ms max 2022.607 ms avg 2.229 ms med 0.042 ms std 60.349 G wr 1st byte cnt 4252 min 0.006 ms max 0.087 ms avg 0.007 ms med 0.007 ms std 0.003 H write close cnt 4252 min 0.012 ms max 1636.082 ms avg 0.406 ms med 0.019 ms std 25.087 I mkdir cnt 404 min 0.020 ms max 1547.251 ms avg 4.268 ms med 0.031 ms std 76.971 J write rate 8.709 MB/s (data) 5.273 MB/s (open + 1st byte + data + close) A read dir cnt 300 min 0.001 ms max 223.034 ms avg 2.437 ms med 0.004 ms std 17.370 B lstat file cnt 284 min 0.009 ms max 443.022 ms avg 4.373 ms med 0.025 ms std 39.758 C open file cnt 236 min 0.015 ms max 0.096 ms avg 0.020 ms med 0.018 ms std 0.007 D rd 1st byte cnt 236 min 0.184 ms max 564.198 ms avg 83.463 ms med 17.842 ms std 129.717 E read rate 0.699 MB/s (data) 0.210 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=hdd journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31206 min 0.001 ms max 11.425 ms avg 0.086 ms med 0.004 ms std 0.691 B lstat file cnt 29148 min 0.007 ms max 12.122 ms avg 0.064 ms med 0.023 ms std 0.446 C open file cnt 22976 min 0.014 ms max 0.294 ms avg 0.022 ms med 0.022 ms std 0.011 D rd 1st byte cnt 22976 min 0.172 ms max 32.521 ms avg 0.616 ms med 0.277 ms std 1.404 E read rate 69.430 MB/s (data) 22.890 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1669 min 0.001 ms max 47.951 ms avg 0.968 ms med 0.004 ms std 4.703 B lstat file cnt 1562 min 0.007 ms max 76.978 ms avg 0.969 ms med 0.025 ms std 4.824 C open file cnt 1243 min 0.015 ms max 0.097 ms avg 0.021 ms med 0.018 ms std 0.009 D rd 1st byte cnt 1243 min 0.189 ms max 125.925 ms avg 14.819 ms med 15.131 ms std 10.965 E read rate 4.086 MB/s (data) 1.198 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4606 min 0.036 ms max 1918.536 ms avg 1.997 ms med 0.041 ms std 56.947 G wr 1st byte cnt 4606 min 0.006 ms max 0.122 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 4606 min 0.013 ms max 1899.458 ms avg 1.251 ms med 0.019 ms std 47.137 I mkdir cnt 445 min 0.021 ms max 1908.868 ms avg 8.767 ms med 0.035 ms std 112.465 J write rate 13.872 MB/s (data) 6.110 MB/s (open + 1st byte + data + close) A read dir cnt 357 min 0.001 ms max 491.574 ms avg 4.575 ms med 0.004 ms std 37.108 B lstat file cnt 337 min 0.008 ms max 247.382 ms avg 1.557 ms med 0.025 ms std 14.835 C open file cnt 280 min 0.015 ms max 0.094 ms avg 0.020 ms med 0.018 ms std 0.010 D rd 1st byte cnt 280 min 0.183 ms max 534.537 ms avg 66.010 ms med 14.221 ms std 118.888 E read rate 0.640 MB/s (data) 0.223 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=hdd journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30193 min 0.001 ms max 10.830 ms avg 0.086 ms med 0.004 ms std 0.683 B lstat file cnt 28193 min 0.007 ms max 25.041 ms avg 0.068 ms med 0.022 ms std 0.500 C open file cnt 22195 min 0.014 ms max 0.180 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 22195 min 0.173 ms max 97.466 ms avg 0.653 ms med 0.282 ms std 2.077 E read rate 68.569 MB/s (data) 22.138 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1653 min 0.001 ms max 51.261 ms avg 0.935 ms med 0.004 ms std 4.512 B lstat file cnt 1546 min 0.007 ms max 36.263 ms avg 0.916 ms med 0.025 ms std 4.339 C open file cnt 1228 min 0.014 ms max 0.090 ms avg 0.021 ms med 0.018 ms std 0.009 D rd 1st byte cnt 1228 min 0.203 ms max 62.308 ms avg 15.169 ms med 15.081 ms std 11.113 E read rate 4.041 MB/s (data) 1.179 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5245 min 0.035 ms max 1976.262 ms avg 2.321 ms med 0.041 ms std 61.984 G wr 1st byte cnt 5245 min 0.006 ms max 0.242 ms avg 0.007 ms med 0.007 ms std 0.006 H write close cnt 5245 min 0.013 ms max 1642.216 ms avg 0.856 ms med 0.018 ms std 35.194 I mkdir cnt 482 min 0.019 ms max 121.403 ms avg 0.607 ms med 0.030 ms std 6.218 J write rate 15.862 MB/s (data) 6.717 MB/s (open + 1st byte + data + close) A read dir cnt 442 min 0.001 ms max 363.282 ms avg 2.301 ms med 0.004 ms std 22.204 B lstat file cnt 413 min 0.007 ms max 425.753 ms avg 4.434 ms med 0.024 ms std 33.382 C open file cnt 323 min 0.015 ms max 0.095 ms avg 0.020 ms med 0.018 ms std 0.008 D rd 1st byte cnt 323 min 0.185 ms max 549.538 ms avg 61.367 ms med 11.872 ms std 116.463 E read rate 0.977 MB/s (data) 0.265 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=hdd journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30068 min 0.001 ms max 97.567 ms avg 0.094 ms med 0.004 ms std 1.090 B lstat file cnt 28077 min 0.007 ms max 72.055 ms avg 0.072 ms med 0.023 ms std 0.750 C open file cnt 22105 min 0.014 ms max 0.184 ms avg 0.022 ms med 0.022 ms std 0.011 D rd 1st byte cnt 22105 min 0.173 ms max 102.353 ms avg 0.642 ms med 0.283 ms std 1.904 E read rate 68.808 MB/s (data) 22.120 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1686 min 0.001 ms max 131.228 ms avg 0.939 ms med 0.004 ms std 5.242 B lstat file cnt 1579 min 0.007 ms max 84.327 ms avg 0.890 ms med 0.025 ms std 4.542 C open file cnt 1258 min 0.015 ms max 0.094 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 1258 min 0.181 ms max 134.405 ms avg 14.614 ms med 14.630 ms std 13.623 E read rate 4.081 MB/s (data) 1.215 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5461 min 0.036 ms max 1786.539 ms avg 1.513 ms med 0.041 ms std 47.990 G wr 1st byte cnt 5461 min 0.006 ms max 0.418 ms avg 0.007 ms med 0.007 ms std 0.009 H write close cnt 5461 min 0.013 ms max 1481.474 ms avg 0.812 ms med 0.019 ms std 33.809 I mkdir cnt 492 min 0.019 ms max 1767.262 ms avg 5.396 ms med 0.032 ms std 80.103 J write rate 13.222 MB/s (data) 7.204 MB/s (open + 1st byte + data + close) A read dir cnt 393 min 0.001 ms max 520.780 ms avg 8.792 ms med 0.004 ms std 54.751 B lstat file cnt 363 min 0.008 ms max 681.300 ms avg 6.607 ms med 0.025 ms std 50.388 C open file cnt 269 min 0.015 ms max 0.240 ms avg 0.022 ms med 0.018 ms std 0.016 D rd 1st byte cnt 269 min 0.187 ms max 550.849 ms avg 68.704 ms med 13.134 ms std 127.353 E read rate 0.986 MB/s (data) 0.230 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=hdd journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31834 min 0.001 ms max 10.841 ms avg 0.087 ms med 0.004 ms std 0.692 B lstat file cnt 29737 min 0.007 ms max 16.426 ms avg 0.066 ms med 0.023 ms std 0.460 C open file cnt 23450 min 0.014 ms max 0.238 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 23450 min 0.173 ms max 32.441 ms avg 0.635 ms med 0.277 ms std 1.448 E read rate 79.409 MB/s (data) 23.406 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3111 min 0.001 ms max 44.984 ms avg 0.486 ms med 0.004 ms std 3.079 B lstat file cnt 2917 min 0.007 ms max 45.703 ms avg 0.625 ms med 0.024 ms std 3.489 C open file cnt 2333 min 0.014 ms max 0.145 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 2333 min 0.178 ms max 124.612 ms avg 8.013 ms med 0.414 ms std 13.877 E read rate 7.819 MB/s (data) 2.153 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 57 min 0.039 ms max 0.099 ms avg 0.047 ms med 0.043 ms std 0.013 G wr 1st byte cnt 57 min 0.006 ms max 0.014 ms avg 0.007 ms med 0.006 ms std 0.001 H write close cnt 57 min 0.014 ms max 0.077 ms avg 0.021 ms med 0.020 ms std 0.009 I mkdir cnt 1 min 0.065 ms max 0.065 ms avg 0.065 ms med 0.065 ms std 0.000 J write rate 370.348 MB/s (data) 204.618 MB/s (open + 1st byte + data + close) A read dir cnt 12795 min 0.001 ms max 52.534 ms avg 0.149 ms med 0.004 ms std 1.309 B lstat file cnt 11941 min 0.007 ms max 30.476 ms avg 0.129 ms med 0.023 ms std 1.091 C open file cnt 9382 min 0.014 ms max 0.233 ms avg 0.021 ms med 0.017 ms std 0.012 D rd 1st byte cnt 9382 min 0.177 ms max 6524.964 ms avg 3.705 ms med 0.297 ms std 69.637 E read rate 15.355 MB/s (data) 4.385 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=hdd journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30990 min 0.001 ms max 59.767 ms avg 0.090 ms med 0.004 ms std 0.777 B lstat file cnt 28948 min 0.007 ms max 96.055 ms avg 0.070 ms med 0.023 ms std 0.732 C open file cnt 22824 min 0.014 ms max 0.440 ms avg 0.022 ms med 0.020 ms std 0.011 D rd 1st byte cnt 22824 min 0.173 ms max 90.181 ms avg 0.653 ms med 0.281 ms std 1.905 E read rate 77.474 MB/s (data) 22.821 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 2931 min 0.001 ms max 46.691 ms avg 0.502 ms med 0.004 ms std 3.167 B lstat file cnt 2743 min 0.007 ms max 105.001 ms avg 0.737 ms med 0.025 ms std 4.404 C open file cnt 2178 min 0.014 ms max 0.167 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 2178 min 0.184 ms max 157.208 ms avg 8.546 ms med 0.469 ms std 15.847 E read rate 7.325 MB/s (data) 2.013 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 40 min 0.039 ms max 0.067 ms avg 0.044 ms med 0.042 ms std 0.006 G wr 1st byte cnt 40 min 0.006 ms max 0.011 ms avg 0.007 ms med 0.007 ms std 0.001 H write close cnt 40 min 0.014 ms max 0.040 ms avg 0.022 ms med 0.022 ms std 0.006 I mkdir cnt 6 min 0.035 ms max 0.044 ms avg 0.039 ms med 0.040 ms std 0.003 J write rate 376.108 MB/s (data) 167.531 MB/s (open + 1st byte + data + close) A read dir cnt 12171 min 0.001 ms max 37.667 ms avg 0.148 ms med 0.004 ms std 1.282 B lstat file cnt 11367 min 0.007 ms max 82.929 ms avg 0.135 ms med 0.023 ms std 1.401 C open file cnt 8957 min 0.014 ms max 0.285 ms avg 0.021 ms med 0.017 ms std 0.012 D rd 1st byte cnt 8957 min 0.177 ms max 9624.836 ms avg 4.106 ms med 0.297 ms std 103.235 E read rate 18.843 MB/s (data) 4.286 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=hdd journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31721 min 0.001 ms max 13.560 ms avg 0.086 ms med 0.004 ms std 0.686 B lstat file cnt 29631 min 0.007 ms max 11.958 ms avg 0.067 ms med 0.023 ms std 0.467 C open file cnt 23365 min 0.014 ms max 0.188 ms avg 0.022 ms med 0.020 ms std 0.011 D rd 1st byte cnt 23365 min 0.174 ms max 32.400 ms avg 0.637 ms med 0.288 ms std 1.430 E read rate 78.781 MB/s (data) 23.313 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3021 min 0.001 ms max 68.710 ms avg 0.551 ms med 0.004 ms std 3.372 B lstat file cnt 2833 min 0.007 ms max 59.354 ms avg 0.620 ms med 0.024 ms std 3.742 C open file cnt 2267 min 0.014 ms max 0.185 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 2267 min 0.180 ms max 141.898 ms avg 8.371 ms med 0.473 ms std 14.699 E read rate 7.839 MB/s (data) 2.046 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 63 min 0.039 ms max 12.074 ms avg 0.239 ms med 0.042 ms std 1.503 G wr 1st byte cnt 63 min 0.006 ms max 0.068 ms avg 0.009 ms med 0.006 ms std 0.010 H write close cnt 63 min 0.013 ms max 0.083 ms avg 0.021 ms med 0.019 ms std 0.012 I mkdir cnt 3 min 0.026 ms max 0.040 ms avg 0.033 ms med 0.034 ms std 0.006 J write rate 440.908 MB/s (data) 92.953 MB/s (open + 1st byte + data + close) A read dir cnt 13530 min 0.001 ms max 52.257 ms avg 0.150 ms med 0.004 ms std 1.419 B lstat file cnt 12633 min 0.007 ms max 38.746 ms avg 0.127 ms med 0.023 ms std 1.091 C open file cnt 9941 min 0.014 ms max 0.316 ms avg 0.021 ms med 0.018 ms std 0.012 D rd 1st byte cnt 9941 min 0.174 ms max 6674.593 ms avg 3.342 ms med 0.292 ms std 68.968 E read rate 16.511 MB/s (data) 4.795 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=hdd journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30676 min 0.001 ms max 101.447 ms avg 0.091 ms med 0.004 ms std 0.908 B lstat file cnt 28651 min 0.007 ms max 12.944 ms avg 0.066 ms med 0.023 ms std 0.463 C open file cnt 22578 min 0.014 ms max 0.185 ms avg 0.021 ms med 0.020 ms std 0.011 D rd 1st byte cnt 22578 min 0.170 ms max 90.141 ms avg 0.669 ms med 0.283 ms std 2.187 E read rate 77.636 MB/s (data) 22.538 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3119 min 0.001 ms max 91.665 ms avg 0.572 ms med 0.004 ms std 3.797 B lstat file cnt 2925 min 0.007 ms max 45.293 ms avg 0.611 ms med 0.024 ms std 3.397 C open file cnt 2340 min 0.014 ms max 0.180 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 2340 min 0.174 ms max 173.951 ms avg 8.041 ms med 0.378 ms std 15.306 E read rate 8.188 MB/s (data) 2.157 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 20 min 0.040 ms max 0.059 ms avg 0.044 ms med 0.043 ms std 0.004 G wr 1st byte cnt 20 min 0.006 ms max 0.010 ms avg 0.007 ms med 0.007 ms std 0.001 H write close cnt 20 min 0.014 ms max 0.027 ms avg 0.019 ms med 0.019 ms std 0.003 I mkdir cnt 3 min 0.035 ms max 0.047 ms avg 0.041 ms med 0.042 ms std 0.005 J write rate 451.182 MB/s (data) 223.177 MB/s (open + 1st byte + data + close) A read dir cnt 12598 min 0.001 ms max 47.694 ms avg 0.149 ms med 0.004 ms std 1.350 B lstat file cnt 11763 min 0.007 ms max 36.369 ms avg 0.119 ms med 0.023 ms std 0.960 C open file cnt 9259 min 0.014 ms max 0.313 ms avg 0.021 ms med 0.018 ms std 0.012 D rd 1st byte cnt 9259 min 0.178 ms max 9458.731 ms avg 4.138 ms med 0.300 ms std 99.966 E read rate 14.924 MB/s (data) 4.038 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=hdd journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30388 min 0.001 ms max 85.786 ms avg 0.088 ms med 0.004 ms std 0.839 B lstat file cnt 28377 min 0.007 ms max 36.928 ms avg 0.067 ms med 0.023 ms std 0.521 C open file cnt 22343 min 0.014 ms max 0.248 ms avg 0.022 ms med 0.022 ms std 0.011 D rd 1st byte cnt 22343 min 0.173 ms max 97.215 ms avg 0.646 ms med 0.278 ms std 1.995 E read rate 69.505 MB/s (data) 22.314 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1703 min 0.001 ms max 44.963 ms avg 0.926 ms med 0.004 ms std 4.559 B lstat file cnt 1597 min 0.007 ms max 64.839 ms avg 0.861 ms med 0.025 ms std 4.284 C open file cnt 1277 min 0.014 ms max 0.107 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 1277 min 0.182 ms max 150.754 ms avg 14.381 ms med 14.457 ms std 13.847 E read rate 3.977 MB/s (data) 1.191 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 8210 min 0.036 ms max 1385.255 ms avg 2.361 ms med 0.041 ms std 33.087 G wr 1st byte cnt 8210 min 0.006 ms max 0.121 ms avg 0.007 ms med 0.006 ms std 0.003 H write close cnt 8210 min 0.013 ms max 128.845 ms avg 0.035 ms med 0.019 ms std 1.422 I mkdir cnt 758 min 0.019 ms max 1481.164 ms avg 11.147 ms med 0.038 ms std 88.370 J write rate 173.795 MB/s (data) 14.317 MB/s (open + 1st byte + data + close) A read dir cnt 130 min 0.001 ms max 454.968 ms avg 14.884 ms med 0.004 ms std 66.037 B lstat file cnt 120 min 0.007 ms max 300.857 ms avg 12.510 ms med 0.027 ms std 54.107 C open file cnt 92 min 0.015 ms max 0.050 ms avg 0.022 ms med 0.021 ms std 0.006 D rd 1st byte cnt 92 min 0.541 ms max 524.495 ms avg 186.560 ms med 217.043 ms std 133.519 E read rate 0.264 MB/s (data) 0.088 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=hdd journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30148 min 0.001 ms max 100.652 ms avg 0.092 ms med 0.004 ms std 0.935 B lstat file cnt 28151 min 0.007 ms max 10.481 ms avg 0.065 ms med 0.022 ms std 0.455 C open file cnt 22161 min 0.013 ms max 0.242 ms avg 0.022 ms med 0.022 ms std 0.011 D rd 1st byte cnt 22161 min 0.173 ms max 97.142 ms avg 0.639 ms med 0.277 ms std 1.770 E read rate 66.607 MB/s (data) 22.029 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1718 min 0.001 ms max 110.182 ms avg 1.064 ms med 0.004 ms std 5.334 B lstat file cnt 1605 min 0.007 ms max 121.999 ms avg 1.041 ms med 0.025 ms std 5.842 C open file cnt 1266 min 0.014 ms max 0.132 ms avg 0.021 ms med 0.018 ms std 0.009 D rd 1st byte cnt 1266 min 0.194 ms max 112.844 ms avg 14.417 ms med 14.323 ms std 13.136 E read rate 4.242 MB/s (data) 1.217 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 16658 min 0.036 ms max 25389.954 ms avg 2.018 ms med 0.041 ms std 197.057 G wr 1st byte cnt 16658 min 0.006 ms max 0.201 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 16658 min 0.013 ms max 302.396 ms avg 0.037 ms med 0.018 ms std 2.343 I mkdir cnt 1530 min 0.018 ms max 1509.654 ms avg 8.604 ms med 0.026 ms std 74.613 J write rate 318.293 MB/s (data) 17.157 MB/s (open + 1st byte + data + close) A read dir cnt 257 min 0.001 ms max 319.603 ms avg 6.762 ms med 0.004 ms std 37.538 B lstat file cnt 240 min 0.008 ms max 171.583 ms avg 4.503 ms med 0.025 ms std 22.381 C open file cnt 189 min 0.014 ms max 0.100 ms avg 0.021 ms med 0.019 ms std 0.009 D rd 1st byte cnt 189 min 0.224 ms max 675.403 ms avg 151.320 ms med 91.071 ms std 159.367 E read rate 0.274 MB/s (data) 0.105 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=hdd journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 29996 min 0.001 ms max 90.211 ms avg 0.095 ms med 0.004 ms std 1.031 B lstat file cnt 28010 min 0.007 ms max 77.896 ms avg 0.071 ms med 0.023 ms std 0.797 C open file cnt 22053 min 0.014 ms max 0.426 ms avg 0.022 ms med 0.022 ms std 0.012 D rd 1st byte cnt 22053 min 0.173 ms max 102.524 ms avg 0.638 ms med 0.278 ms std 1.828 E read rate 67.339 MB/s (data) 22.030 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1725 min 0.001 ms max 129.089 ms avg 0.960 ms med 0.004 ms std 5.333 B lstat file cnt 1614 min 0.007 ms max 45.928 ms avg 0.906 ms med 0.025 ms std 4.420 C open file cnt 1281 min 0.015 ms max 0.154 ms avg 0.021 ms med 0.019 ms std 0.010 D rd 1st byte cnt 1281 min 0.187 ms max 120.150 ms avg 14.698 ms med 14.634 ms std 13.748 E read rate 4.285 MB/s (data) 1.191 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 12466 min 0.037 ms max 52332.811 ms avg 4.575 ms med 0.042 ms std 468.790 G wr 1st byte cnt 12466 min 0.006 ms max 0.221 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 12466 min 0.013 ms max 0.423 ms avg 0.018 ms med 0.018 ms std 0.008 I mkdir cnt 1170 min 0.019 ms max 1003.563 ms avg 11.287 ms med 0.026 ms std 80.450 J write rate 473.314 MB/s (data) 7.875 MB/s (open + 1st byte + data + close) A read dir cnt 342 min 0.001 ms max 429.990 ms avg 9.789 ms med 0.004 ms std 53.630 B lstat file cnt 321 min 0.008 ms max 237.318 ms avg 3.401 ms med 0.026 ms std 25.139 C open file cnt 259 min 0.015 ms max 0.090 ms avg 0.021 ms med 0.019 ms std 0.007 D rd 1st byte cnt 259 min 0.210 ms max 745.766 ms avg 175.786 ms med 152.267 ms std 157.871 E read rate 0.289 MB/s (data) 0.090 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=hdd journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30386 min 0.001 ms max 104.232 ms avg 0.089 ms med 0.004 ms std 0.955 B lstat file cnt 28371 min 0.007 ms max 99.118 ms avg 0.070 ms med 0.023 ms std 0.752 C open file cnt 22329 min 0.013 ms max 0.256 ms avg 0.022 ms med 0.022 ms std 0.011 D rd 1st byte cnt 22329 min 0.172 ms max 69.742 ms avg 0.635 ms med 0.276 ms std 1.735 E read rate 68.322 MB/s (data) 22.355 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1736 min 0.001 ms max 118.200 ms avg 1.008 ms med 0.004 ms std 5.235 B lstat file cnt 1625 min 0.007 ms max 47.036 ms avg 0.766 ms med 0.025 ms std 3.883 C open file cnt 1294 min 0.014 ms max 0.098 ms avg 0.021 ms med 0.019 ms std 0.009 D rd 1st byte cnt 1294 min 0.185 ms max 114.216 ms avg 14.150 ms med 14.209 ms std 12.293 E read rate 4.075 MB/s (data) 1.215 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6167 min 0.036 ms max 57051.915 ms avg 9.770 ms med 0.041 ms std 726.533 G wr 1st byte cnt 6167 min 0.006 ms max 0.123 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 6167 min 0.013 ms max 0.273 ms avg 0.019 ms med 0.018 ms std 0.009 I mkdir cnt 582 min 0.018 ms max 1006.231 ms avg 7.219 ms med 0.026 ms std 69.422 J write rate 472.162 MB/s (data) 3.762 MB/s (open + 1st byte + data + close) A read dir cnt 256 min 0.001 ms max 525.474 ms avg 12.855 ms med 0.004 ms std 66.832 B lstat file cnt 240 min 0.007 ms max 313.319 ms avg 2.073 ms med 0.025 ms std 21.702 C open file cnt 195 min 0.015 ms max 0.083 ms avg 0.020 ms med 0.018 ms std 0.009 D rd 1st byte cnt 195 min 0.733 ms max 1208.141 ms avg 213.629 ms med 196.172 ms std 174.735 E read rate 0.237 MB/s (data) 0.072 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=hdd journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30861 min 0.001 ms max 65.866 ms avg 0.090 ms med 0.004 ms std 0.794 B lstat file cnt 28824 min 0.007 ms max 74.237 ms avg 0.067 ms med 0.022 ms std 0.625 C open file cnt 22713 min 0.014 ms max 0.313 ms avg 0.022 ms med 0.020 ms std 0.012 D rd 1st byte cnt 22713 min 0.170 ms max 103.009 ms avg 0.660 ms med 0.281 ms std 2.058 E read rate 77.399 MB/s (data) 22.723 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3355 min 0.001 ms max 106.079 ms avg 0.519 ms med 0.004 ms std 3.581 B lstat file cnt 3139 min 0.007 ms max 76.925 ms avg 0.487 ms med 0.024 ms std 3.384 C open file cnt 2487 min 0.014 ms max 0.270 ms avg 0.021 ms med 0.018 ms std 0.012 D rd 1st byte cnt 2487 min 0.183 ms max 128.951 ms avg 7.814 ms med 0.367 ms std 14.997 E read rate 9.094 MB/s (data) 2.244 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 10780 min 0.036 ms max 473.607 ms avg 0.109 ms med 0.041 ms std 4.610 G wr 1st byte cnt 10780 min 0.006 ms max 17.067 ms avg 0.008 ms med 0.006 ms std 0.164 H write close cnt 10780 min 0.012 ms max 0.428 ms avg 0.018 ms med 0.018 ms std 0.008 I mkdir cnt 1004 min 0.018 ms max 19592.233 ms avg 29.447 ms med 0.026 ms std 644.768 J write rate 240.950 MB/s (data) 129.961 MB/s (open + 1st byte + data + close) A read dir cnt 9256 min 0.001 ms max 32.343 ms avg 0.146 ms med 0.004 ms std 1.222 B lstat file cnt 8638 min 0.007 ms max 45.528 ms avg 0.138 ms med 0.023 ms std 1.309 C open file cnt 6783 min 0.014 ms max 0.266 ms avg 0.021 ms med 0.017 ms std 0.013 D rd 1st byte cnt 6783 min 0.178 ms max 312.909 ms avg 2.819 ms med 0.297 ms std 16.400 E read rate 14.757 MB/s (data) 5.163 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=hdd journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30902 min 0.001 ms max 100.637 ms avg 0.090 ms med 0.004 ms std 0.900 B lstat file cnt 28864 min 0.007 ms max 19.883 ms avg 0.068 ms med 0.023 ms std 0.494 C open file cnt 22752 min 0.014 ms max 0.845 ms avg 0.022 ms med 0.021 ms std 0.013 D rd 1st byte cnt 22752 min 0.170 ms max 90.895 ms avg 0.655 ms med 0.279 ms std 1.994 E read rate 77.084 MB/s (data) 22.783 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3374 min 0.001 ms max 47.733 ms avg 0.472 ms med 0.004 ms std 3.150 B lstat file cnt 3157 min 0.007 ms max 104.078 ms avg 0.567 ms med 0.024 ms std 3.664 C open file cnt 2506 min 0.014 ms max 0.233 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 2506 min 0.178 ms max 174.614 ms avg 7.643 ms med 0.380 ms std 14.318 E read rate 8.630 MB/s (data) 2.233 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 11807 min 0.036 ms max 41.330 ms avg 0.112 ms med 0.042 ms std 1.183 G wr 1st byte cnt 11807 min 0.006 ms max 0.460 ms avg 0.007 ms med 0.007 ms std 0.008 H write close cnt 11807 min 0.013 ms max 20338.636 ms avg 1.784 ms med 0.019 ms std 187.193 I mkdir cnt 1103 min 0.020 ms max 13563.429 ms avg 15.723 ms med 0.039 ms std 412.071 J write rate 261.131 MB/s (data) 18.753 MB/s (open + 1st byte + data + close) A read dir cnt 9511 min 0.001 ms max 64.214 ms avg 0.193 ms med 0.004 ms std 1.869 B lstat file cnt 8870 min 0.007 ms max 32.325 ms avg 0.154 ms med 0.023 ms std 1.265 C open file cnt 6947 min 0.014 ms max 0.220 ms avg 0.021 ms med 0.017 ms std 0.013 D rd 1st byte cnt 6947 min 0.175 ms max 304.998 ms avg 3.596 ms med 0.300 ms std 19.314 E read rate 12.910 MB/s (data) 4.209 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=hdd journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31058 min 0.001 ms max 10.855 ms avg 0.087 ms med 0.004 ms std 0.688 B lstat file cnt 29008 min 0.007 ms max 35.046 ms avg 0.068 ms med 0.023 ms std 0.535 C open file cnt 22860 min 0.014 ms max 0.209 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 22860 min 0.172 ms max 106.030 ms avg 0.653 ms med 0.283 ms std 1.886 E read rate 76.635 MB/s (data) 22.840 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 2952 min 0.001 ms max 52.068 ms avg 0.595 ms med 0.004 ms std 3.663 B lstat file cnt 2766 min 0.007 ms max 55.699 ms avg 0.637 ms med 0.024 ms std 3.445 C open file cnt 2210 min 0.014 ms max 0.366 ms avg 0.021 ms med 0.018 ms std 0.013 D rd 1st byte cnt 2210 min 0.179 ms max 166.091 ms avg 8.452 ms med 0.743 ms std 15.362 E read rate 7.435 MB/s (data) 1.981 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 15873 min 0.036 ms max 285.630 ms avg 0.118 ms med 0.042 ms std 3.201 G wr 1st byte cnt 15873 min 0.006 ms max 0.256 ms avg 0.007 ms med 0.007 ms std 0.006 H write close cnt 15873 min 0.013 ms max 2225.610 ms avg 0.181 ms med 0.019 ms std 17.771 I mkdir cnt 1467 min 0.021 ms max 16896.337 ms avg 21.031 ms med 0.039 ms std 551.371 J write rate 292.000 MB/s (data) 86.597 MB/s (open + 1st byte + data + close) A read dir cnt 9995 min 0.001 ms max 255.224 ms avg 0.188 ms med 0.004 ms std 2.925 B lstat file cnt 9325 min 0.007 ms max 90.969 ms avg 0.160 ms med 0.023 ms std 1.630 C open file cnt 7317 min 0.014 ms max 0.312 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 7317 min 0.179 ms max 312.443 ms avg 3.207 ms med 0.301 ms std 17.556 E read rate 15.437 MB/s (data) 4.710 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=hdd journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30765 min 0.001 ms max 55.518 ms avg 0.092 ms med 0.004 ms std 0.859 B lstat file cnt 28732 min 0.006 ms max 14.433 ms avg 0.066 ms med 0.023 ms std 0.466 C open file cnt 22635 min 0.013 ms max 0.477 ms avg 0.022 ms med 0.021 ms std 0.012 D rd 1st byte cnt 22635 min 0.175 ms max 82.452 ms avg 0.659 ms med 0.286 ms std 1.774 E read rate 76.354 MB/s (data) 22.588 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3049 min 0.001 ms max 123.876 ms avg 0.547 ms med 0.004 ms std 3.887 B lstat file cnt 2859 min 0.007 ms max 44.087 ms avg 0.536 ms med 0.024 ms std 3.197 C open file cnt 2290 min 0.014 ms max 0.154 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 2290 min 0.181 ms max 124.493 ms avg 8.212 ms med 0.400 ms std 15.320 E read rate 7.581 MB/s (data) 2.073 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 7553 min 0.036 ms max 42538.944 ms avg 5.738 ms med 0.041 ms std 489.453 G wr 1st byte cnt 7553 min 0.006 ms max 0.166 ms avg 0.007 ms med 0.006 ms std 0.006 H write close cnt 7553 min 0.012 ms max 0.295 ms avg 0.018 ms med 0.018 ms std 0.011 I mkdir cnt 699 min 0.019 ms max 590.087 ms avg 4.203 ms med 0.027 ms std 38.118 J write rate 418.921 MB/s (data) 6.388 MB/s (open + 1st byte + data + close) A read dir cnt 14311 min 0.001 ms max 76.122 ms avg 0.159 ms med 0.004 ms std 1.491 B lstat file cnt 13373 min 0.007 ms max 400.295 ms avg 0.303 ms med 0.023 ms std 6.697 C open file cnt 10558 min 0.014 ms max 0.266 ms avg 0.021 ms med 0.017 ms std 0.012 D rd 1st byte cnt 10558 min 0.173 ms max 3731.451 ms avg 3.602 ms med 0.298 ms std 41.096 E read rate 14.813 MB/s (data) 4.456 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=hdd journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30354 min 0.001 ms max 86.163 ms avg 0.093 ms med 0.004 ms std 0.990 B lstat file cnt 28346 min 0.007 ms max 10.711 ms avg 0.065 ms med 0.022 ms std 0.453 C open file cnt 22325 min 0.014 ms max 0.308 ms avg 0.022 ms med 0.022 ms std 0.011 D rd 1st byte cnt 22325 min 0.170 ms max 93.981 ms avg 0.636 ms med 0.277 ms std 1.940 E read rate 68.123 MB/s (data) 22.213 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1611 min 0.001 ms max 125.220 ms avg 1.068 ms med 0.004 ms std 5.562 B lstat file cnt 1505 min 0.007 ms max 149.309 ms avg 1.080 ms med 0.025 ms std 6.779 C open file cnt 1186 min 0.015 ms max 0.133 ms avg 0.022 ms med 0.019 ms std 0.011 D rd 1st byte cnt 1186 min 0.200 ms max 126.952 ms avg 15.180 ms med 15.203 ms std 13.184 E read rate 3.864 MB/s (data) 1.164 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5388 min 0.036 ms max 632.549 ms avg 1.642 ms med 0.042 ms std 22.225 G wr 1st byte cnt 5388 min 0.006 ms max 0.209 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 5388 min 0.012 ms max 11580.345 ms avg 3.328 ms med 0.019 ms std 173.284 I mkdir cnt 510 min 0.023 ms max 881.465 ms avg 16.691 ms med 0.033 ms std 98.408 J write rate 35.486 MB/s (data) 5.996 MB/s (open + 1st byte + data + close) A read dir cnt 160 min 0.001 ms max 496.559 ms avg 18.949 ms med 0.004 ms std 77.041 B lstat file cnt 148 min 0.008 ms max 1038.863 ms avg 11.158 ms med 0.026 ms std 89.751 C open file cnt 112 min 0.016 ms max 0.076 ms avg 0.020 ms med 0.019 ms std 0.007 D rd 1st byte cnt 112 min 0.644 ms max 1171.076 ms avg 237.245 ms med 211.441 ms std 170.531 E read rate 0.266 MB/s (data) 0.066 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=hdd journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30191 min 0.001 ms max 95.197 ms avg 0.094 ms med 0.004 ms std 1.025 B lstat file cnt 28191 min 0.006 ms max 79.930 ms avg 0.068 ms med 0.022 ms std 0.656 C open file cnt 22193 min 0.014 ms max 0.209 ms avg 0.022 ms med 0.022 ms std 0.011 D rd 1st byte cnt 22193 min 0.174 ms max 97.206 ms avg 0.645 ms med 0.278 ms std 2.085 E read rate 69.315 MB/s (data) 22.117 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1789 min 0.001 ms max 59.979 ms avg 0.840 ms med 0.004 ms std 4.472 B lstat file cnt 1673 min 0.007 ms max 54.444 ms avg 0.943 ms med 0.025 ms std 4.674 C open file cnt 1325 min 0.014 ms max 0.101 ms avg 0.022 ms med 0.019 ms std 0.011 D rd 1st byte cnt 1325 min 0.181 ms max 167.511 ms avg 14.326 ms med 13.839 ms std 15.062 E read rate 4.462 MB/s (data) 1.230 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5690 min 0.037 ms max 1005.627 ms avg 2.204 ms med 0.042 ms std 29.432 G wr 1st byte cnt 5690 min 0.006 ms max 0.279 ms avg 0.007 ms med 0.007 ms std 0.006 H write close cnt 5690 min 0.013 ms max 5016.071 ms avg 1.173 ms med 0.019 ms std 67.210 I mkdir cnt 529 min 0.020 ms max 1704.320 ms avg 16.497 ms med 0.036 ms std 112.686 J write rate 93.928 MB/s (data) 9.525 MB/s (open + 1st byte + data + close) A read dir cnt 130 min 0.001 ms max 269.108 ms avg 6.039 ms med 0.004 ms std 35.433 B lstat file cnt 123 min 0.007 ms max 281.949 ms avg 15.294 ms med 0.026 ms std 54.846 C open file cnt 102 min 0.015 ms max 0.090 ms avg 0.021 ms med 0.019 ms std 0.009 D rd 1st byte cnt 102 min 0.316 ms max 588.364 ms avg 184.465 ms med 192.386 ms std 128.213 E read rate 0.312 MB/s (data) 0.099 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=hdd journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30060 min 0.001 ms max 77.890 ms avg 0.095 ms med 0.004 ms std 1.076 B lstat file cnt 28070 min 0.007 ms max 79.917 ms avg 0.069 ms med 0.022 ms std 0.670 C open file cnt 22101 min 0.014 ms max 0.259 ms avg 0.022 ms med 0.022 ms std 0.011 D rd 1st byte cnt 22101 min 0.170 ms max 94.520 ms avg 0.635 ms med 0.277 ms std 1.851 E read rate 67.005 MB/s (data) 22.030 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1799 min 0.001 ms max 50.470 ms avg 0.848 ms med 0.004 ms std 4.311 B lstat file cnt 1683 min 0.007 ms max 64.421 ms avg 0.781 ms med 0.025 ms std 4.140 C open file cnt 1333 min 0.014 ms max 0.128 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 1333 min 0.178 ms max 126.715 ms avg 13.817 ms med 13.644 ms std 13.647 E read rate 4.179 MB/s (data) 1.258 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4005 min 0.037 ms max 1372.238 ms avg 2.798 ms med 0.042 ms std 41.417 G wr 1st byte cnt 4005 min 0.006 ms max 0.184 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 4005 min 0.013 ms max 5406.781 ms avg 1.698 ms med 0.019 ms std 86.001 I mkdir cnt 375 min 0.023 ms max 953.128 ms avg 17.367 ms med 0.033 ms std 106.243 J write rate 10.440 MB/s (data) 4.436 MB/s (open + 1st byte + data + close) A read dir cnt 137 min 0.002 ms max 304.862 ms avg 5.804 ms med 0.004 ms std 36.990 B lstat file cnt 131 min 0.008 ms max 219.373 ms avg 1.701 ms med 0.027 ms std 19.091 C open file cnt 114 min 0.015 ms max 0.095 ms avg 0.023 ms med 0.020 ms std 0.014 D rd 1st byte cnt 114 min 0.563 ms max 1137.415 ms avg 215.961 ms med 202.079 ms std 169.482 E read rate 0.231 MB/s (data) 0.076 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=hdd journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30107 min 0.001 ms max 79.112 ms avg 0.090 ms med 0.004 ms std 0.882 B lstat file cnt 28114 min 0.007 ms max 18.924 ms avg 0.067 ms med 0.022 ms std 0.485 C open file cnt 22136 min 0.014 ms max 0.279 ms avg 0.022 ms med 0.022 ms std 0.011 D rd 1st byte cnt 22136 min 0.170 ms max 102.583 ms avg 0.647 ms med 0.279 ms std 2.067 E read rate 68.217 MB/s (data) 22.088 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1644 min 0.001 ms max 33.850 ms avg 0.883 ms med 0.004 ms std 4.097 B lstat file cnt 1536 min 0.007 ms max 35.782 ms avg 0.726 ms med 0.025 ms std 3.621 C open file cnt 1216 min 0.014 ms max 0.103 ms avg 0.021 ms med 0.018 ms std 0.009 D rd 1st byte cnt 1216 min 0.173 ms max 132.388 ms avg 15.227 ms med 15.308 ms std 13.195 E read rate 3.784 MB/s (data) 1.162 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 8463 min 0.036 ms max 681.246 ms avg 0.784 ms med 0.041 ms std 15.920 G wr 1st byte cnt 8463 min 0.006 ms max 0.116 ms avg 0.007 ms med 0.007 ms std 0.003 H write close cnt 8463 min 0.013 ms max 13293.461 ms avg 1.623 ms med 0.018 ms std 144.527 I mkdir cnt 793 min 0.019 ms max 1298.425 ms avg 8.691 ms med 0.032 ms std 75.146 J write rate 23.505 MB/s (data) 8.821 MB/s (open + 1st byte + data + close) A read dir cnt 128 min 0.001 ms max 439.739 ms avg 12.734 ms med 0.004 ms std 59.765 B lstat file cnt 119 min 0.007 ms max 636.454 ms avg 15.763 ms med 0.026 ms std 85.692 C open file cnt 93 min 0.015 ms max 0.033 ms avg 0.019 ms med 0.018 ms std 0.004 D rd 1st byte cnt 93 min 3.120 ms max 721.928 ms avg 256.232 ms med 240.432 ms std 160.024 E read rate 0.189 MB/s (data) 0.063 MB/s (readdir + open + 1st byte + data)