Linux 2.6.24-24-server relatime barrier=0 fs=ext3 disk=hdd journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31757 min 0.002 ms max 12.626 ms avg 0.089 ms med 0.005 ms std 0.700 B lstat file cnt 29666 min 0.008 ms max 16.522 ms avg 0.064 ms med 0.022 ms std 0.471 C open file cnt 23394 min 0.015 ms max 0.145 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 23394 min 0.169 ms max 32.502 ms avg 0.641 ms med 0.280 ms std 1.458 E read rate 79.357 MB/s (data) 23.278 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 8768 min 0.002 ms max 206.257 ms avg 0.138 ms med 0.005 ms std 2.353 B lstat file cnt 8213 min 0.008 ms max 205.676 ms avg 0.113 ms med 0.023 ms std 2.352 C open file cnt 6547 min 0.014 ms max 0.127 ms avg 0.018 ms med 0.018 ms std 0.006 D rd 1st byte cnt 6547 min 0.172 ms max 222.029 ms avg 2.822 ms med 0.290 ms std 20.199 E read rate 19.457 MB/s (data) 5.899 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 68 min 0.038 ms max 0.052 ms avg 0.042 ms med 0.042 ms std 0.003 G wr 1st byte cnt 68 min 0.007 ms max 0.010 ms avg 0.007 ms med 0.007 ms std 0.001 H write close cnt 68 min 0.012 ms max 15.516 ms avg 0.244 ms med 0.017 ms std 1.866 I mkdir cnt 5 min 0.025 ms max 36.170 ms avg 7.256 ms med 0.028 ms std 14.457 J write rate 424.521 MB/s (data) 34.300 MB/s (open + 1st byte + data + close) A read dir cnt 6486 min 0.002 ms max 73.726 ms avg 0.447 ms med 0.005 ms std 3.171 B lstat file cnt 6051 min 0.008 ms max 38.817 ms avg 0.353 ms med 0.023 ms std 2.411 C open file cnt 4742 min 0.015 ms max 0.160 ms avg 0.019 ms med 0.018 ms std 0.007 D rd 1st byte cnt 4742 min 0.175 ms max 170.259 ms avg 5.697 ms med 0.311 ms std 13.569 E read rate 11.576 MB/s (data) 2.885 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=0 fs=ext3 disk=hdd journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31866 min 0.002 ms max 10.874 ms avg 0.089 ms med 0.005 ms std 0.700 B lstat file cnt 29766 min 0.008 ms max 11.469 ms avg 0.063 ms med 0.020 ms std 0.460 C open file cnt 23468 min 0.014 ms max 0.148 ms avg 0.018 ms med 0.016 ms std 0.005 D rd 1st byte cnt 23468 min 0.170 ms max 14.115 ms avg 0.628 ms med 0.279 ms std 1.420 E read rate 75.842 MB/s (data) 23.239 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3587 min 0.002 ms max 44.856 ms avg 0.526 ms med 0.005 ms std 3.194 B lstat file cnt 3354 min 0.008 ms max 41.943 ms avg 0.454 ms med 0.022 ms std 2.876 C open file cnt 2653 min 0.015 ms max 0.100 ms avg 0.019 ms med 0.018 ms std 0.005 D rd 1st byte cnt 2653 min 0.172 ms max 127.769 ms avg 7.104 ms med 0.334 ms std 14.061 E read rate 9.054 MB/s (data) 2.389 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 397 min 0.037 ms max 67730.803 ms avg 170.666 ms med 0.040 ms std 3395.025 G wr 1st byte cnt 397 min 0.007 ms max 0.079 ms avg 0.008 ms med 0.007 ms std 0.004 H write close cnt 397 min 0.012 ms max 38.806 ms avg 0.114 ms med 0.016 ms std 1.944 I mkdir cnt 37 min 0.021 ms max 184.772 ms avg 13.249 ms med 0.025 ms std 35.823 J write rate 136.372 MB/s (data) 0.216 MB/s (open + 1st byte + data + close) A read dir cnt 10019 min 0.002 ms max 53.079 ms avg 0.453 ms med 0.005 ms std 3.057 B lstat file cnt 9366 min 0.007 ms max 62.466 ms avg 0.581 ms med 0.021 ms std 3.533 C open file cnt 7408 min 0.015 ms max 0.153 ms avg 0.019 ms med 0.018 ms std 0.007 D rd 1st byte cnt 7408 min 0.173 ms max 172.639 ms avg 6.532 ms med 0.316 ms std 14.492 E read rate 9.368 MB/s (data) 2.515 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=1 fs=ext3 disk=hdd journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31639 min 0.002 ms max 10.870 ms avg 0.088 ms med 0.005 ms std 0.688 B lstat file cnt 29558 min 0.008 ms max 11.791 ms avg 0.064 ms med 0.023 ms std 0.455 C open file cnt 23318 min 0.015 ms max 0.161 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 23318 min 0.171 ms max 18.832 ms avg 0.633 ms med 0.276 ms std 1.440 E read rate 76.481 MB/s (data) 23.327 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3341 min 0.002 ms max 38.620 ms avg 0.503 ms med 0.004 ms std 3.070 B lstat file cnt 3126 min 0.008 ms max 54.037 ms avg 0.587 ms med 0.019 ms std 3.445 C open file cnt 2477 min 0.015 ms max 0.101 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 2477 min 0.174 ms max 134.912 ms avg 7.500 ms med 0.337 ms std 14.075 E read rate 8.083 MB/s (data) 2.212 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 188 min 0.038 ms max 36328.635 ms avg 193.344 ms med 0.041 ms std 2642.474 G wr 1st byte cnt 188 min 0.006 ms max 0.018 ms avg 0.008 ms med 0.007 ms std 0.001 H write close cnt 188 min 0.012 ms max 0.065 ms avg 0.016 ms med 0.016 ms std 0.004 I mkdir cnt 17 min 0.021 ms max 167.048 ms avg 25.039 ms med 0.033 ms std 46.259 J write rate 32.145 MB/s (data) 0.204 MB/s (open + 1st byte + data + close) A read dir cnt 5585 min 0.002 ms max 66.814 ms avg 0.511 ms med 0.005 ms std 3.404 B lstat file cnt 5220 min 0.008 ms max 53.936 ms avg 0.542 ms med 0.022 ms std 3.269 C open file cnt 4125 min 0.015 ms max 0.099 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 4125 min 0.176 ms max 260.535 ms avg 6.922 ms med 0.322 ms std 15.730 E read rate 8.405 MB/s (data) 2.428 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=1 fs=ext3 disk=hdd journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31896 min 0.002 ms max 11.509 ms avg 0.088 ms med 0.005 ms std 0.691 B lstat file cnt 29795 min 0.007 ms max 11.720 ms avg 0.062 ms med 0.021 ms std 0.449 C open file cnt 23495 min 0.015 ms max 0.153 ms avg 0.018 ms med 0.017 ms std 0.005 D rd 1st byte cnt 23495 min 0.169 ms max 32.707 ms avg 0.627 ms med 0.279 ms std 1.430 E read rate 75.976 MB/s (data) 23.320 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3034 min 0.002 ms max 37.040 ms avg 0.488 ms med 0.005 ms std 2.885 B lstat file cnt 2846 min 0.008 ms max 48.515 ms avg 0.642 ms med 0.021 ms std 3.687 C open file cnt 2283 min 0.015 ms max 0.111 ms avg 0.019 ms med 0.018 ms std 0.007 D rd 1st byte cnt 2283 min 0.167 ms max 176.652 ms avg 8.226 ms med 0.516 ms std 14.520 E read rate 7.502 MB/s (data) 2.057 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 30 min 0.039 ms max 0.084 ms avg 0.044 ms med 0.041 ms std 0.008 G wr 1st byte cnt 30 min 0.007 ms max 0.013 ms avg 0.008 ms med 0.007 ms std 0.001 H write close cnt 30 min 0.013 ms max 0.019 ms avg 0.016 ms med 0.016 ms std 0.002 I mkdir cnt 3 min 0.023 ms max 36.437 ms avg 12.163 ms med 0.030 ms std 17.164 J write rate 25.835 MB/s (data) 24.974 MB/s (open + 1st byte + data + close) A read dir cnt 4781 min 0.002 ms max 77.191 ms avg 0.465 ms med 0.005 ms std 3.309 B lstat file cnt 4465 min 0.008 ms max 51.760 ms avg 0.551 ms med 0.023 ms std 3.381 C open file cnt 3518 min 0.015 ms max 0.133 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 3518 min 0.171 ms max 174.105 ms avg 7.040 ms med 0.328 ms std 15.278 E read rate 8.981 MB/s (data) 2.481 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=0 fs=ext3 disk=hdd journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31369 min 0.002 ms max 11.508 ms avg 0.087 ms med 0.005 ms std 0.686 B lstat file cnt 29304 min 0.008 ms max 10.776 ms avg 0.060 ms med 0.019 ms std 0.427 C open file cnt 23113 min 0.014 ms max 0.122 ms avg 0.018 ms med 0.017 ms std 0.006 D rd 1st byte cnt 23113 min 0.170 ms max 32.634 ms avg 0.628 ms med 0.275 ms std 1.453 E read rate 70.850 MB/s (data) 22.855 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1578 min 0.002 ms max 47.637 ms avg 0.981 ms med 0.005 ms std 4.642 B lstat file cnt 1475 min 0.008 ms max 71.139 ms avg 0.933 ms med 0.023 ms std 4.759 C open file cnt 1165 min 0.016 ms max 0.085 ms avg 0.020 ms med 0.019 ms std 0.005 D rd 1st byte cnt 1165 min 0.201 ms max 71.443 ms avg 15.678 ms med 15.517 ms std 10.381 E read rate 3.712 MB/s (data) 1.130 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4891 min 0.037 ms max 1735.092 ms avg 2.087 ms med 0.041 ms std 56.819 G wr 1st byte cnt 4891 min 0.006 ms max 5.217 ms avg 0.009 ms med 0.007 ms std 0.075 H write close cnt 4891 min 0.012 ms max 1707.878 ms avg 0.679 ms med 0.017 ms std 32.710 I mkdir cnt 455 min 0.019 ms max 1657.195 ms avg 12.104 ms med 0.025 ms std 127.774 J write rate 14.418 MB/s (data) 6.837 MB/s (open + 1st byte + data + close) A read dir cnt 369 min 0.002 ms max 519.424 ms avg 5.387 ms med 0.005 ms std 41.795 B lstat file cnt 344 min 0.008 ms max 364.916 ms avg 3.374 ms med 0.024 ms std 28.827 C open file cnt 270 min 0.016 ms max 0.083 ms avg 0.021 ms med 0.019 ms std 0.007 D rd 1st byte cnt 270 min 0.177 ms max 633.203 ms avg 70.115 ms med 16.498 ms std 129.500 E read rate 0.688 MB/s (data) 0.216 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=0 fs=ext3 disk=hdd journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31445 min 0.002 ms max 13.714 ms avg 0.087 ms med 0.005 ms std 0.693 B lstat file cnt 29377 min 0.008 ms max 11.073 ms avg 0.061 ms med 0.018 ms std 0.454 C open file cnt 23176 min 0.014 ms max 0.102 ms avg 0.018 ms med 0.016 ms std 0.005 D rd 1st byte cnt 23176 min 0.172 ms max 18.681 ms avg 0.627 ms med 0.277 ms std 1.434 E read rate 71.432 MB/s (data) 22.915 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1951 min 0.002 ms max 38.629 ms avg 0.793 ms med 0.005 ms std 3.986 B lstat file cnt 1824 min 0.008 ms max 66.765 ms avg 0.736 ms med 0.023 ms std 4.066 C open file cnt 1443 min 0.015 ms max 0.104 ms avg 0.020 ms med 0.019 ms std 0.006 D rd 1st byte cnt 1443 min 0.175 ms max 76.700 ms avg 12.979 ms med 13.480 ms std 11.411 E read rate 4.683 MB/s (data) 1.344 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4501 min 0.036 ms max 2024.154 ms avg 3.155 ms med 0.040 ms std 72.257 G wr 1st byte cnt 4501 min 0.007 ms max 0.109 ms avg 0.008 ms med 0.007 ms std 0.004 H write close cnt 4501 min 0.012 ms max 1827.031 ms avg 1.126 ms med 0.017 ms std 42.968 I mkdir cnt 432 min 0.020 ms max 62.628 ms avg 1.049 ms med 0.027 ms std 6.009 J write rate 15.251 MB/s (data) 5.351 MB/s (open + 1st byte + data + close) A read dir cnt 328 min 0.002 ms max 490.110 ms avg 10.302 ms med 0.005 ms std 55.355 B lstat file cnt 302 min 0.008 ms max 364.913 ms avg 4.173 ms med 0.023 ms std 32.034 C open file cnt 224 min 0.016 ms max 0.086 ms avg 0.021 ms med 0.019 ms std 0.007 D rd 1st byte cnt 224 min 0.205 ms max 592.103 ms avg 80.688 ms med 15.615 ms std 127.326 E read rate 0.737 MB/s (data) 0.194 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=1 fs=ext3 disk=hdd journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31535 min 0.002 ms max 11.516 ms avg 0.085 ms med 0.005 ms std 0.677 B lstat file cnt 29459 min 0.007 ms max 13.640 ms avg 0.062 ms med 0.022 ms std 0.443 C open file cnt 23234 min 0.015 ms max 0.110 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 23234 min 0.169 ms max 32.695 ms avg 0.621 ms med 0.273 ms std 1.440 E read rate 71.780 MB/s (data) 23.095 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1871 min 0.002 ms max 65.634 ms avg 0.836 ms med 0.005 ms std 4.383 B lstat file cnt 1751 min 0.008 ms max 52.251 ms avg 0.875 ms med 0.023 ms std 4.381 C open file cnt 1392 min 0.015 ms max 0.104 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 1392 min 0.187 ms max 82.689 ms avg 13.213 ms med 13.781 ms std 11.344 E read rate 4.338 MB/s (data) 1.278 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4501 min 0.036 ms max 1935.359 ms avg 1.656 ms med 0.041 ms std 52.895 G wr 1st byte cnt 4501 min 0.007 ms max 0.079 ms avg 0.008 ms med 0.007 ms std 0.004 H write close cnt 4501 min 0.012 ms max 1850.077 ms avg 0.772 ms med 0.016 ms std 35.809 I mkdir cnt 432 min 0.019 ms max 111.934 ms avg 1.039 ms med 0.024 ms std 6.977 J write rate 8.419 MB/s (data) 5.328 MB/s (open + 1st byte + data + close) A read dir cnt 331 min 0.002 ms max 376.813 ms avg 3.022 ms med 0.005 ms std 28.835 B lstat file cnt 312 min 0.009 ms max 359.485 ms avg 2.801 ms med 0.024 ms std 26.427 C open file cnt 252 min 0.015 ms max 0.092 ms avg 0.021 ms med 0.019 ms std 0.009 D rd 1st byte cnt 252 min 0.187 ms max 603.593 ms avg 84.482 ms med 21.560 ms std 140.558 E read rate 0.804 MB/s (data) 0.212 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=1 fs=ext3 disk=hdd journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30912 min 0.002 ms max 66.428 ms avg 0.089 ms med 0.004 ms std 0.823 B lstat file cnt 28873 min 0.008 ms max 76.343 ms avg 0.067 ms med 0.021 ms std 0.734 C open file cnt 22758 min 0.015 ms max 0.152 ms avg 0.018 ms med 0.017 ms std 0.006 D rd 1st byte cnt 22758 min 0.168 ms max 90.162 ms avg 0.636 ms med 0.272 ms std 1.801 E read rate 70.950 MB/s (data) 22.664 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1634 min 0.002 ms max 81.469 ms avg 0.909 ms med 0.005 ms std 4.912 B lstat file cnt 1528 min 0.008 ms max 56.843 ms avg 0.805 ms med 0.024 ms std 4.146 C open file cnt 1212 min 0.015 ms max 0.100 ms avg 0.019 ms med 0.018 ms std 0.004 D rd 1st byte cnt 1212 min 0.182 ms max 126.438 ms avg 15.108 ms med 15.043 ms std 12.892 E read rate 3.797 MB/s (data) 1.171 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4036 min 0.037 ms max 1916.139 ms avg 1.381 ms med 0.041 ms std 46.538 G wr 1st byte cnt 4036 min 0.006 ms max 0.158 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 4036 min 0.012 ms max 1842.229 ms avg 0.867 ms med 0.017 ms std 38.166 I mkdir cnt 387 min 0.019 ms max 1698.783 ms avg 5.855 ms med 0.025 ms std 86.742 J write rate 8.465 MB/s (data) 5.540 MB/s (open + 1st byte + data + close) A read dir cnt 428 min 0.002 ms max 595.596 ms avg 4.436 ms med 0.004 ms std 39.921 B lstat file cnt 403 min 0.008 ms max 383.374 ms avg 3.271 ms med 0.021 ms std 29.994 C open file cnt 325 min 0.015 ms max 0.091 ms avg 0.020 ms med 0.018 ms std 0.009 D rd 1st byte cnt 325 min 0.189 ms max 558.363 ms avg 55.390 ms med 5.021 ms std 110.733 E read rate 1.038 MB/s (data) 0.306 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=0 fs=ext3 disk=hdd journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31958 min 0.002 ms max 17.841 ms avg 0.088 ms med 0.005 ms std 0.697 B lstat file cnt 29853 min 0.007 ms max 16.524 ms avg 0.063 ms med 0.021 ms std 0.458 C open file cnt 23539 min 0.015 ms max 0.118 ms avg 0.018 ms med 0.017 ms std 0.005 D rd 1st byte cnt 23539 min 0.169 ms max 32.708 ms avg 0.640 ms med 0.279 ms std 1.461 E read rate 79.921 MB/s (data) 23.397 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 8532 min 0.002 ms max 200.341 ms avg 0.137 ms med 0.005 ms std 2.320 B lstat file cnt 7992 min 0.007 ms max 200.305 ms avg 0.119 ms med 0.023 ms std 2.329 C open file cnt 6369 min 0.015 ms max 0.106 ms avg 0.018 ms med 0.018 ms std 0.005 D rd 1st byte cnt 6369 min 0.173 ms max 225.657 ms avg 2.555 ms med 0.285 ms std 18.873 E read rate 15.126 MB/s (data) 5.767 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 40 min 0.040 ms max 0.047 ms avg 0.043 ms med 0.042 ms std 0.002 G wr 1st byte cnt 40 min 0.006 ms max 0.008 ms avg 0.007 ms med 0.007 ms std 0.000 H write close cnt 40 min 0.013 ms max 0.023 ms avg 0.018 ms med 0.018 ms std 0.003 I mkdir cnt 3 min 0.028 ms max 0.036 ms avg 0.031 ms med 0.030 ms std 0.003 J write rate 432.194 MB/s (data) 197.941 MB/s (open + 1st byte + data + close) A read dir cnt 6562 min 0.002 ms max 48.623 ms avg 0.435 ms med 0.005 ms std 2.867 B lstat file cnt 6119 min 0.008 ms max 79.853 ms avg 0.319 ms med 0.023 ms std 2.555 C open file cnt 4798 min 0.015 ms max 0.111 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 4798 min 0.174 ms max 427.026 ms avg 6.026 ms med 0.304 ms std 15.396 E read rate 10.293 MB/s (data) 2.760 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=0 fs=ext3 disk=hdd journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 32075 min 0.002 ms max 17.845 ms avg 0.087 ms med 0.005 ms std 0.687 B lstat file cnt 29956 min 0.008 ms max 11.604 ms avg 0.062 ms med 0.022 ms std 0.438 C open file cnt 23601 min 0.014 ms max 0.157 ms avg 0.018 ms med 0.017 ms std 0.005 D rd 1st byte cnt 23601 min 0.171 ms max 14.244 ms avg 0.623 ms med 0.274 ms std 1.423 E read rate 76.530 MB/s (data) 23.472 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3447 min 0.002 ms max 59.056 ms avg 0.501 ms med 0.005 ms std 3.147 B lstat file cnt 3225 min 0.008 ms max 46.028 ms avg 0.437 ms med 0.021 ms std 2.967 C open file cnt 2556 min 0.015 ms max 0.138 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 2556 min 0.179 ms max 117.497 ms avg 7.487 ms med 0.348 ms std 13.718 E read rate 8.667 MB/s (data) 2.290 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 48 min 0.039 ms max 0.088 ms avg 0.044 ms med 0.042 ms std 0.007 G wr 1st byte cnt 48 min 0.007 ms max 0.061 ms avg 0.008 ms med 0.007 ms std 0.008 H write close cnt 48 min 0.013 ms max 0.020 ms avg 0.016 ms med 0.016 ms std 0.002 I mkdir cnt 7 min 0.024 ms max 0.033 ms avg 0.027 ms med 0.026 ms std 0.003 J write rate 492.350 MB/s (data) 320.041 MB/s (open + 1st byte + data + close) A read dir cnt 15281 min 0.002 ms max 65.375 ms avg 0.408 ms med 0.005 ms std 2.916 B lstat file cnt 14279 min 0.008 ms max 71.057 ms avg 0.450 ms med 0.021 ms std 3.014 C open file cnt 11281 min 0.015 ms max 0.122 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 11281 min 0.170 ms max 7563.443 ms avg 6.794 ms med 0.313 ms std 72.585 E read rate 10.395 MB/s (data) 2.539 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=1 fs=ext3 disk=hdd journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31866 min 0.002 ms max 15.726 ms avg 0.089 ms med 0.005 ms std 0.705 B lstat file cnt 29767 min 0.008 ms max 12.012 ms avg 0.062 ms med 0.021 ms std 0.445 C open file cnt 23472 min 0.014 ms max 0.133 ms avg 0.018 ms med 0.018 ms std 0.005 D rd 1st byte cnt 23472 min 0.171 ms max 32.836 ms avg 0.625 ms med 0.276 ms std 1.437 E read rate 75.687 MB/s (data) 23.289 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3172 min 0.002 ms max 44.282 ms avg 0.571 ms med 0.005 ms std 3.331 B lstat file cnt 2972 min 0.008 ms max 37.853 ms avg 0.454 ms med 0.021 ms std 2.788 C open file cnt 2367 min 0.015 ms max 0.152 ms avg 0.019 ms med 0.018 ms std 0.007 D rd 1st byte cnt 2367 min 0.175 ms max 142.351 ms avg 8.053 ms med 0.382 ms std 14.237 E read rate 8.182 MB/s (data) 2.161 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 20 min 0.039 ms max 0.046 ms avg 0.041 ms med 0.041 ms std 0.002 G wr 1st byte cnt 20 min 0.007 ms max 0.009 ms avg 0.008 ms med 0.008 ms std 0.001 H write close cnt 20 min 0.012 ms max 0.071 ms avg 0.021 ms med 0.017 ms std 0.016 I mkdir cnt 3 min 0.026 ms max 0.037 ms avg 0.031 ms med 0.030 ms std 0.005 J write rate 506.684 MB/s (data) 235.362 MB/s (open + 1st byte + data + close) A read dir cnt 15616 min 0.002 ms max 93.383 ms avg 0.427 ms med 0.005 ms std 3.087 B lstat file cnt 14594 min 0.008 ms max 53.696 ms avg 0.383 ms med 0.023 ms std 2.539 C open file cnt 11538 min 0.015 ms max 0.154 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 11538 min 0.172 ms max 6856.716 ms avg 6.549 ms med 0.308 ms std 65.253 E read rate 10.898 MB/s (data) 2.623 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=1 fs=ext3 disk=hdd journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31733 min 0.002 ms max 16.651 ms avg 0.086 ms med 0.005 ms std 0.683 B lstat file cnt 29646 min 0.008 ms max 12.067 ms avg 0.063 ms med 0.024 ms std 0.442 C open file cnt 23385 min 0.015 ms max 0.145 ms avg 0.019 ms med 0.018 ms std 0.005 D rd 1st byte cnt 23385 min 0.170 ms max 32.774 ms avg 0.630 ms med 0.279 ms std 1.442 E read rate 76.073 MB/s (data) 23.299 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3067 min 0.002 ms max 77.047 ms avg 0.566 ms med 0.004 ms std 3.543 B lstat file cnt 2874 min 0.008 ms max 51.842 ms avg 0.602 ms med 0.019 ms std 3.599 C open file cnt 2295 min 0.015 ms max 0.100 ms avg 0.019 ms med 0.018 ms std 0.005 D rd 1st byte cnt 2295 min 0.177 ms max 133.465 ms avg 8.054 ms med 0.612 ms std 14.185 E read rate 7.590 MB/s (data) 2.109 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 63 min 0.040 ms max 0.050 ms avg 0.044 ms med 0.043 ms std 0.002 G wr 1st byte cnt 63 min 0.006 ms max 0.066 ms avg 0.008 ms med 0.007 ms std 0.007 H write close cnt 63 min 0.014 ms max 0.022 ms avg 0.017 ms med 0.017 ms std 0.002 I mkdir cnt 3 min 0.029 ms max 0.041 ms avg 0.037 ms med 0.041 ms std 0.006 J write rate 475.959 MB/s (data) 233.306 MB/s (open + 1st byte + data + close) A read dir cnt 15774 min 0.002 ms max 78.974 ms avg 0.406 ms med 0.005 ms std 2.949 B lstat file cnt 14745 min 0.008 ms max 62.521 ms avg 0.435 ms med 0.024 ms std 2.879 C open file cnt 11667 min 0.015 ms max 0.177 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 11667 min 0.173 ms max 7642.767 ms avg 6.714 ms med 0.307 ms std 72.127 E read rate 10.089 MB/s (data) 2.538 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=0 fs=ext3 disk=hdd journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31417 min 0.002 ms max 11.527 ms avg 0.087 ms med 0.005 ms std 0.690 B lstat file cnt 29349 min 0.008 ms max 14.869 ms avg 0.062 ms med 0.021 ms std 0.455 C open file cnt 23148 min 0.014 ms max 0.160 ms avg 0.018 ms med 0.017 ms std 0.006 D rd 1st byte cnt 23148 min 0.169 ms max 32.692 ms avg 0.626 ms med 0.274 ms std 1.451 E read rate 71.583 MB/s (data) 22.957 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1830 min 0.002 ms max 64.736 ms avg 0.794 ms med 0.004 ms std 4.073 B lstat file cnt 1709 min 0.008 ms max 46.158 ms avg 0.791 ms med 0.022 ms std 4.030 C open file cnt 1348 min 0.015 ms max 0.095 ms avg 0.019 ms med 0.018 ms std 0.005 D rd 1st byte cnt 1348 min 0.176 ms max 71.648 ms avg 13.743 ms med 14.093 ms std 11.019 E read rate 4.226 MB/s (data) 1.260 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 7542 min 0.037 ms max 8190.475 ms avg 2.595 ms med 0.042 ms std 96.909 G wr 1st byte cnt 7542 min 0.006 ms max 0.079 ms avg 0.007 ms med 0.007 ms std 0.003 H write close cnt 7542 min 0.012 ms max 345.413 ms avg 0.106 ms med 0.017 ms std 5.442 I mkdir cnt 703 min 0.021 ms max 1490.963 ms avg 10.117 ms med 0.028 ms std 87.596 J write rate 174.587 MB/s (data) 13.003 MB/s (open + 1st byte + data + close) A read dir cnt 160 min 0.002 ms max 387.260 ms avg 11.755 ms med 0.005 ms std 55.528 B lstat file cnt 149 min 0.008 ms max 309.784 ms avg 11.051 ms med 0.024 ms std 54.109 C open file cnt 115 min 0.015 ms max 0.082 ms avg 0.021 ms med 0.020 ms std 0.007 D rd 1st byte cnt 115 min 0.208 ms max 507.770 ms avg 156.676 ms med 201.632 ms std 129.375 E read rate 0.378 MB/s (data) 0.111 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=0 fs=ext3 disk=hdd journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30578 min 0.002 ms max 11.535 ms avg 0.086 ms med 0.005 ms std 0.684 B lstat file cnt 28558 min 0.008 ms max 99.355 ms avg 0.069 ms med 0.022 ms std 0.861 C open file cnt 22498 min 0.014 ms max 0.123 ms avg 0.019 ms med 0.017 ms std 0.006 D rd 1st byte cnt 22498 min 0.168 ms max 110.466 ms avg 0.652 ms med 0.273 ms std 2.189 E read rate 71.617 MB/s (data) 22.533 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1602 min 0.002 ms max 48.425 ms avg 1.027 ms med 0.005 ms std 4.911 B lstat file cnt 1500 min 0.008 ms max 42.181 ms avg 0.916 ms med 0.025 ms std 4.281 C open file cnt 1194 min 0.015 ms max 0.132 ms avg 0.020 ms med 0.019 ms std 0.007 D rd 1st byte cnt 1194 min 0.180 ms max 130.785 ms avg 15.904 ms med 15.664 ms std 13.484 E read rate 4.114 MB/s (data) 1.132 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 20884 min 0.036 ms max 55171.253 ms avg 2.986 ms med 0.040 ms std 382.824 G wr 1st byte cnt 20884 min 0.006 ms max 0.115 ms avg 0.007 ms med 0.007 ms std 0.003 H write close cnt 20884 min 0.012 ms max 749.492 ms avg 0.128 ms med 0.016 ms std 7.559 I mkdir cnt 1942 min 0.018 ms max 662.840 ms avg 3.358 ms med 0.024 ms std 35.656 J write rate 72.796 MB/s (data) 10.199 MB/s (open + 1st byte + data + close) A read dir cnt 380 min 0.002 ms max 1401.298 ms avg 20.095 ms med 0.005 ms std 113.992 B lstat file cnt 354 min 0.008 ms max 419.225 ms avg 8.095 ms med 0.025 ms std 48.519 C open file cnt 281 min 0.015 ms max 0.118 ms avg 0.021 ms med 0.020 ms std 0.008 D rd 1st byte cnt 281 min 0.197 ms max 1465.829 ms avg 165.843 ms med 94.259 ms std 180.837 E read rate 0.255 MB/s (data) 0.083 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=1 fs=ext3 disk=hdd journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31446 min 0.002 ms max 11.546 ms avg 0.087 ms med 0.005 ms std 0.690 B lstat file cnt 29376 min 0.008 ms max 12.518 ms avg 0.062 ms med 0.020 ms std 0.450 C open file cnt 23170 min 0.015 ms max 0.104 ms avg 0.018 ms med 0.017 ms std 0.005 D rd 1st byte cnt 23170 min 0.169 ms max 32.720 ms avg 0.624 ms med 0.272 ms std 1.446 E read rate 71.404 MB/s (data) 22.981 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1932 min 0.002 ms max 35.637 ms avg 0.755 ms med 0.004 ms std 3.821 B lstat file cnt 1807 min 0.008 ms max 45.488 ms avg 0.777 ms med 0.020 ms std 4.066 C open file cnt 1432 min 0.016 ms max 0.106 ms avg 0.020 ms med 0.019 ms std 0.006 D rd 1st byte cnt 1432 min 0.183 ms max 91.516 ms avg 12.956 ms med 13.090 ms std 11.970 E read rate 4.472 MB/s (data) 1.328 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 13014 min 0.036 ms max 2356.527 ms avg 1.306 ms med 0.041 ms std 27.174 G wr 1st byte cnt 13014 min 0.007 ms max 0.104 ms avg 0.008 ms med 0.008 ms std 0.004 H write close cnt 13014 min 0.012 ms max 430.268 ms avg 0.128 ms med 0.017 ms std 5.816 I mkdir cnt 1217 min 0.019 ms max 941.406 ms avg 6.735 ms med 0.025 ms std 65.868 J write rate 175.230 MB/s (data) 22.409 MB/s (open + 1st byte + data + close) A read dir cnt 120 min 0.002 ms max 394.859 ms avg 3.693 ms med 0.005 ms std 36.096 B lstat file cnt 115 min 0.009 ms max 263.246 ms avg 4.401 ms med 0.026 ms std 32.810 C open file cnt 101 min 0.018 ms max 0.087 ms avg 0.022 ms med 0.021 ms std 0.008 D rd 1st byte cnt 101 min 0.281 ms max 648.636 ms avg 200.517 ms med 228.256 ms std 137.152 E read rate 0.262 MB/s (data) 0.081 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=1 fs=ext3 disk=hdd journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30526 min 0.002 ms max 85.543 ms avg 0.092 ms med 0.005 ms std 0.948 B lstat file cnt 28510 min 0.008 ms max 79.572 ms avg 0.068 ms med 0.021 ms std 0.803 C open file cnt 22461 min 0.015 ms max 0.138 ms avg 0.018 ms med 0.017 ms std 0.006 D rd 1st byte cnt 22461 min 0.167 ms max 107.850 ms avg 0.643 ms med 0.275 ms std 1.929 E read rate 70.466 MB/s (data) 22.416 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1638 min 0.002 ms max 105.944 ms avg 1.071 ms med 0.005 ms std 5.607 B lstat file cnt 1536 min 0.008 ms max 47.053 ms avg 0.851 ms med 0.026 ms std 4.065 C open file cnt 1228 min 0.015 ms max 0.125 ms avg 0.020 ms med 0.019 ms std 0.007 D rd 1st byte cnt 1228 min 0.177 ms max 132.115 ms avg 15.002 ms med 14.989 ms std 13.959 E read rate 3.970 MB/s (data) 1.164 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 7483 min 0.036 ms max 6214.650 ms avg 1.675 ms med 0.041 ms std 74.189 G wr 1st byte cnt 7483 min 0.007 ms max 0.105 ms avg 0.008 ms med 0.007 ms std 0.004 H write close cnt 7483 min 0.012 ms max 21.753 ms avg 0.019 ms med 0.016 ms std 0.251 I mkdir cnt 709 min 0.018 ms max 1802.302 ms avg 25.496 ms med 0.024 ms std 163.498 J write rate 518.171 MB/s (data) 21.031 MB/s (open + 1st byte + data + close) A read dir cnt 107 min 0.002 ms max 617.661 ms avg 17.822 ms med 0.005 ms std 85.390 B lstat file cnt 100 min 0.008 ms max 167.935 ms avg 1.968 ms med 0.026 ms std 16.776 C open file cnt 79 min 0.017 ms max 0.091 ms avg 0.023 ms med 0.021 ms std 0.009 D rd 1st byte cnt 79 min 0.300 ms max 1183.905 ms avg 260.726 ms med 242.628 ms std 201.212 E read rate 0.241 MB/s (data) 0.072 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=0 fs=ext3 disk=hdd journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30736 min 0.002 ms max 11.889 ms avg 0.089 ms med 0.005 ms std 0.699 B lstat file cnt 28707 min 0.008 ms max 19.148 ms avg 0.065 ms med 0.023 ms std 0.487 C open file cnt 22621 min 0.015 ms max 0.157 ms avg 0.018 ms med 0.017 ms std 0.005 D rd 1st byte cnt 22621 min 0.169 ms max 127.182 ms avg 0.666 ms med 0.277 ms std 2.082 E read rate 75.538 MB/s (data) 22.516 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 9003 min 0.002 ms max 18.276 ms avg 0.105 ms med 0.005 ms std 0.785 B lstat file cnt 8434 min 0.008 ms max 202.231 ms avg 0.122 ms med 0.022 ms std 2.318 C open file cnt 6724 min 0.015 ms max 0.112 ms avg 0.018 ms med 0.017 ms std 0.005 D rd 1st byte cnt 6724 min 0.171 ms max 223.145 ms avg 2.556 ms med 0.284 ms std 18.868 E read rate 17.084 MB/s (data) 6.089 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1405 min 0.037 ms max 356.520 ms avg 0.373 ms med 0.042 ms std 9.573 G wr 1st byte cnt 1405 min 0.007 ms max 0.126 ms avg 0.008 ms med 0.007 ms std 0.006 H write close cnt 1405 min 0.012 ms max 7502.725 ms avg 5.494 ms med 0.017 ms std 200.153 I mkdir cnt 144 min 0.022 ms max 23.348 ms avg 0.190 ms med 0.028 ms std 1.937 J write rate 1.672 MB/s (data) 1.299 MB/s (open + 1st byte + data + close) A read dir cnt 7359 min 0.002 ms max 69.250 ms avg 0.420 ms med 0.005 ms std 3.050 B lstat file cnt 6881 min 0.008 ms max 66.337 ms avg 0.358 ms med 0.022 ms std 2.568 C open file cnt 5446 min 0.014 ms max 0.156 ms avg 0.019 ms med 0.018 ms std 0.007 D rd 1st byte cnt 5446 min 0.173 ms max 7782.501 ms avg 7.470 ms med 0.304 ms std 107.416 E read rate 11.436 MB/s (data) 2.443 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=0 fs=ext3 disk=hdd journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 32055 min 0.002 ms max 12.695 ms avg 0.088 ms med 0.005 ms std 0.693 B lstat file cnt 29938 min 0.008 ms max 11.605 ms avg 0.062 ms med 0.021 ms std 0.446 C open file cnt 23589 min 0.014 ms max 0.147 ms avg 0.018 ms med 0.017 ms std 0.006 D rd 1st byte cnt 23589 min 0.169 ms max 18.744 ms avg 0.622 ms med 0.273 ms std 1.424 E read rate 76.351 MB/s (data) 23.430 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3432 min 0.002 ms max 59.756 ms avg 0.505 ms med 0.005 ms std 3.236 B lstat file cnt 3211 min 0.008 ms max 65.749 ms avg 0.586 ms med 0.023 ms std 3.480 C open file cnt 2546 min 0.015 ms max 0.122 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 2546 min 0.174 ms max 129.665 ms avg 7.480 ms med 0.352 ms std 14.436 E read rate 9.172 MB/s (data) 2.313 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1620 min 0.037 ms max 17.109 ms avg 0.055 ms med 0.042 ms std 0.424 G wr 1st byte cnt 1620 min 0.006 ms max 0.078 ms avg 0.008 ms med 0.007 ms std 0.004 H write close cnt 1620 min 0.012 ms max 0.157 ms avg 0.017 ms med 0.017 ms std 0.008 I mkdir cnt 166 min 0.021 ms max 60.575 ms avg 0.393 ms med 0.027 ms std 4.685 J write rate 1.744 MB/s (data) 1.738 MB/s (open + 1st byte + data + close) A read dir cnt 6385 min 0.002 ms max 51.854 ms avg 0.478 ms med 0.005 ms std 3.093 B lstat file cnt 5970 min 0.008 ms max 58.463 ms avg 0.498 ms med 0.023 ms std 3.017 C open file cnt 4726 min 0.015 ms max 0.110 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 4726 min 0.173 ms max 157.198 ms avg 6.794 ms med 0.322 ms std 14.788 E read rate 8.459 MB/s (data) 2.410 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=1 fs=ext3 disk=hdd journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31088 min 0.002 ms max 84.145 ms avg 0.091 ms med 0.005 ms std 0.913 B lstat file cnt 29035 min 0.008 ms max 70.837 ms avg 0.068 ms med 0.022 ms std 0.741 C open file cnt 22880 min 0.015 ms max 0.160 ms avg 0.018 ms med 0.017 ms std 0.006 D rd 1st byte cnt 22880 min 0.170 ms max 96.998 ms avg 0.636 ms med 0.280 ms std 1.643 E read rate 73.719 MB/s (data) 22.855 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3020 min 0.002 ms max 39.996 ms avg 0.482 ms med 0.005 ms std 3.037 B lstat file cnt 2832 min 0.008 ms max 90.280 ms avg 0.593 ms med 0.022 ms std 3.861 C open file cnt 2266 min 0.015 ms max 0.150 ms avg 0.019 ms med 0.018 ms std 0.008 D rd 1st byte cnt 2266 min 0.186 ms max 121.287 ms avg 8.638 ms med 0.384 ms std 15.401 E read rate 8.085 MB/s (data) 2.035 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 926 min 0.037 ms max 0.109 ms avg 0.042 ms med 0.041 ms std 0.005 G wr 1st byte cnt 926 min 0.007 ms max 0.104 ms avg 0.008 ms med 0.007 ms std 0.003 H write close cnt 926 min 0.012 ms max 413.890 ms avg 0.462 ms med 0.015 ms std 13.593 I mkdir cnt 85 min 0.020 ms max 0.038 ms avg 0.025 ms med 0.025 ms std 0.003 J write rate 2.157 MB/s (data) 2.091 MB/s (open + 1st byte + data + close) A read dir cnt 3639 min 0.002 ms max 46.991 ms avg 0.482 ms med 0.005 ms std 3.122 B lstat file cnt 3412 min 0.008 ms max 63.333 ms avg 0.602 ms med 0.023 ms std 3.421 C open file cnt 2729 min 0.015 ms max 0.092 ms avg 0.019 ms med 0.018 ms std 0.005 D rd 1st byte cnt 2729 min 0.181 ms max 255.863 ms avg 7.569 ms med 0.329 ms std 16.272 E read rate 7.550 MB/s (data) 2.279 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=1 fs=ext3 disk=hdd journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31946 min 0.002 ms max 11.638 ms avg 0.087 ms med 0.005 ms std 0.688 B lstat file cnt 29841 min 0.008 ms max 11.933 ms avg 0.063 ms med 0.019 ms std 0.462 C open file cnt 23528 min 0.015 ms max 0.130 ms avg 0.018 ms med 0.017 ms std 0.005 D rd 1st byte cnt 23528 min 0.175 ms max 32.557 ms avg 0.626 ms med 0.276 ms std 1.431 E read rate 75.964 MB/s (data) 23.342 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 3418 min 0.002 ms max 63.883 ms avg 0.530 ms med 0.005 ms std 3.310 B lstat file cnt 3197 min 0.008 ms max 69.988 ms avg 0.578 ms med 0.024 ms std 3.624 C open file cnt 2532 min 0.015 ms max 0.157 ms avg 0.020 ms med 0.019 ms std 0.007 D rd 1st byte cnt 2532 min 0.178 ms max 126.664 ms avg 7.288 ms med 0.343 ms std 13.370 E read rate 8.463 MB/s (data) 2.298 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 230 min 0.037 ms max 0.107 ms avg 0.043 ms med 0.041 ms std 0.009 G wr 1st byte cnt 230 min 0.007 ms max 0.014 ms avg 0.008 ms med 0.008 ms std 0.001 H write close cnt 230 min 0.012 ms max 481.431 ms avg 2.109 ms med 0.016 ms std 31.674 I mkdir cnt 23 min 0.022 ms max 0.087 ms avg 0.029 ms med 0.024 ms std 0.013 J write rate 1.007 MB/s (data) 0.975 MB/s (open + 1st byte + data + close) A read dir cnt 5220 min 0.002 ms max 275.735 ms avg 0.542 ms med 0.005 ms std 4.940 B lstat file cnt 4879 min 0.008 ms max 372.964 ms avg 0.609 ms med 0.024 ms std 6.239 C open file cnt 3855 min 0.015 ms max 0.104 ms avg 0.019 ms med 0.019 ms std 0.005 D rd 1st byte cnt 3855 min 0.174 ms max 191.794 ms avg 6.965 ms med 0.316 ms std 15.493 E read rate 8.496 MB/s (data) 2.437 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=0 fs=ext3 disk=hdd journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31401 min 0.002 ms max 26.883 ms avg 0.087 ms med 0.005 ms std 0.708 B lstat file cnt 29336 min 0.007 ms max 12.468 ms avg 0.063 ms med 0.022 ms std 0.455 C open file cnt 23145 min 0.015 ms max 0.123 ms avg 0.019 ms med 0.018 ms std 0.005 D rd 1st byte cnt 23145 min 0.168 ms max 32.655 ms avg 0.622 ms med 0.272 ms std 1.450 E read rate 71.555 MB/s (data) 23.016 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1838 min 0.002 ms max 49.344 ms avg 0.843 ms med 0.004 ms std 4.241 B lstat file cnt 1719 min 0.008 ms max 51.278 ms avg 0.816 ms med 0.022 ms std 4.017 C open file cnt 1361 min 0.015 ms max 0.099 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 1361 min 0.187 ms max 102.037 ms avg 13.804 ms med 13.975 ms std 12.274 E read rate 4.409 MB/s (data) 1.258 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4522 min 0.036 ms max 885.893 ms avg 1.218 ms med 0.041 ms std 23.235 G wr 1st byte cnt 4522 min 0.006 ms max 0.092 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 4522 min 0.011 ms max 1005.184 ms avg 0.408 ms med 0.016 ms std 16.498 I mkdir cnt 430 min 0.018 ms max 1225.064 ms avg 16.866 ms med 0.025 ms std 122.555 J write rate 10.990 MB/s (data) 7.379 MB/s (open + 1st byte + data + close) A read dir cnt 168 min 0.002 ms max 348.706 ms avg 12.824 ms med 0.005 ms std 57.605 B lstat file cnt 156 min 0.009 ms max 176.386 ms avg 1.459 ms med 0.023 ms std 14.491 C open file cnt 117 min 0.016 ms max 0.095 ms avg 0.021 ms med 0.019 ms std 0.009 D rd 1st byte cnt 117 min 0.194 ms max 1419.915 ms avg 168.615 ms med 181.999 ms std 183.459 E read rate 0.381 MB/s (data) 0.103 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=0 fs=ext3 disk=hdd journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30451 min 0.002 ms max 103.297 ms avg 0.089 ms med 0.005 ms std 0.903 B lstat file cnt 28437 min 0.008 ms max 44.711 ms avg 0.066 ms med 0.021 ms std 0.557 C open file cnt 22396 min 0.014 ms max 0.130 ms avg 0.018 ms med 0.017 ms std 0.006 D rd 1st byte cnt 22396 min 0.169 ms max 87.898 ms avg 0.642 ms med 0.274 ms std 1.882 E read rate 68.535 MB/s (data) 22.318 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1738 min 0.002 ms max 36.781 ms avg 0.862 ms med 0.005 ms std 4.076 B lstat file cnt 1628 min 0.008 ms max 98.029 ms avg 0.992 ms med 0.024 ms std 5.438 C open file cnt 1296 min 0.015 ms max 0.161 ms avg 0.020 ms med 0.018 ms std 0.007 D rd 1st byte cnt 1296 min 0.190 ms max 140.634 ms avg 13.945 ms med 14.265 ms std 13.183 E read rate 4.017 MB/s (data) 1.237 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 3809 min 0.036 ms max 739.976 ms avg 1.130 ms med 0.041 ms std 20.090 G wr 1st byte cnt 3809 min 0.006 ms max 0.091 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 3809 min 0.011 ms max 1026.711 ms avg 1.090 ms med 0.016 ms std 29.322 I mkdir cnt 370 min 0.018 ms max 1280.477 ms avg 15.355 ms med 0.025 ms std 104.678 J write rate 10.073 MB/s (data) 6.360 MB/s (open + 1st byte + data + close) A read dir cnt 159 min 0.002 ms max 567.694 ms avg 13.133 ms med 0.005 ms std 66.221 B lstat file cnt 148 min 0.008 ms max 536.283 ms avg 11.084 ms med 0.025 ms std 60.839 C open file cnt 114 min 0.016 ms max 0.098 ms avg 0.021 ms med 0.019 ms std 0.008 D rd 1st byte cnt 114 min 0.196 ms max 631.613 ms avg 158.264 ms med 161.380 ms std 151.106 E read rate 0.376 MB/s (data) 0.111 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server relatime barrier=1 fs=ext3 disk=hdd journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30383 min 0.002 ms max 100.643 ms avg 0.097 ms med 0.005 ms std 1.177 B lstat file cnt 28373 min 0.008 ms max 18.892 ms avg 0.063 ms med 0.022 ms std 0.461 C open file cnt 22347 min 0.015 ms max 0.126 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 22347 min 0.169 ms max 103.541 ms avg 0.641 ms med 0.273 ms std 1.851 E read rate 69.195 MB/s (data) 22.186 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1861 min 0.002 ms max 97.743 ms avg 0.941 ms med 0.004 ms std 5.239 B lstat file cnt 1741 min 0.008 ms max 49.297 ms avg 0.792 ms med 0.021 ms std 4.100 C open file cnt 1382 min 0.015 ms max 0.105 ms avg 0.019 ms med 0.018 ms std 0.005 D rd 1st byte cnt 1382 min 0.174 ms max 115.104 ms avg 13.658 ms med 13.666 ms std 13.605 E read rate 4.613 MB/s (data) 1.270 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5815 min 0.036 ms max 1128.793 ms avg 0.773 ms med 0.040 ms std 20.545 G wr 1st byte cnt 5815 min 0.007 ms max 0.109 ms avg 0.008 ms med 0.007 ms std 0.004 H write close cnt 5815 min 0.011 ms max 901.749 ms avg 0.778 ms med 0.015 ms std 23.402 I mkdir cnt 542 min 0.020 ms max 985.558 ms avg 10.579 ms med 0.026 ms std 82.563 J write rate 14.087 MB/s (data) 8.715 MB/s (open + 1st byte + data + close) A read dir cnt 128 min 0.002 ms max 391.319 ms avg 4.637 ms med 0.005 ms std 38.089 B lstat file cnt 123 min 0.008 ms max 163.594 ms avg 1.690 ms med 0.025 ms std 14.918 C open file cnt 109 min 0.016 ms max 0.077 ms avg 0.020 ms med 0.019 ms std 0.006 D rd 1st byte cnt 109 min 0.275 ms max 736.772 ms avg 201.612 ms med 211.191 ms std 146.320 E read rate 0.352 MB/s (data) 0.084 MB/s (readdir + open + 1st byte + data) Linux 2.6.24-24-server atime barrier=1 fs=ext3 disk=hdd journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30480 min 0.002 ms max 13.063 ms avg 0.088 ms med 0.005 ms std 0.693 B lstat file cnt 28464 min 0.008 ms max 96.240 ms avg 0.066 ms med 0.021 ms std 0.729 C open file cnt 22418 min 0.014 ms max 0.123 ms avg 0.018 ms med 0.017 ms std 0.005 D rd 1st byte cnt 22418 min 0.171 ms max 80.531 ms avg 0.650 ms med 0.275 ms std 1.965 E read rate 69.775 MB/s (data) 22.325 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 1749 min 0.002 ms max 85.754 ms avg 0.926 ms med 0.005 ms std 4.843 B lstat file cnt 1637 min 0.008 ms max 52.179 ms avg 0.812 ms med 0.023 ms std 4.230 C open file cnt 1299 min 0.015 ms max 0.096 ms avg 0.019 ms med 0.018 ms std 0.006 D rd 1st byte cnt 1299 min 0.177 ms max 121.835 ms avg 14.275 ms med 14.106 ms std 13.628 E read rate 4.117 MB/s (data) 1.208 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6625 min 0.036 ms max 589.901 ms avg 0.451 ms med 0.040 ms std 12.968 G wr 1st byte cnt 6625 min 0.006 ms max 0.088 ms avg 0.007 ms med 0.007 ms std 0.003 H write close cnt 6625 min 0.012 ms max 4640.700 ms avg 1.272 ms med 0.015 ms std 59.852 I mkdir cnt 611 min 0.017 ms max 809.544 ms avg 7.818 ms med 0.025 ms std 59.848 J write rate 19.297 MB/s (data) 10.298 MB/s (open + 1st byte + data + close) A read dir cnt 138 min 0.002 ms max 578.446 ms avg 11.202 ms med 0.005 ms std 68.679 B lstat file cnt 132 min 0.008 ms max 144.321 ms avg 1.117 ms med 0.024 ms std 12.512 C open file cnt 115 min 0.015 ms max 0.081 ms avg 0.020 ms med 0.019 ms std 0.006 D rd 1st byte cnt 115 min 0.188 ms max 997.779 ms avg 151.914 ms med 133.784 ms std 153.932 E read rate 0.278 MB/s (data) 0.099 MB/s (readdir + open + 1st byte + data)