Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35744 min 0.001 ms max 12.062 ms avg 0.052 ms med 0.004 ms std 0.483 B lstat file cnt 33350 min 0.007 ms max 16.184 ms avg 0.051 ms med 0.022 ms std 0.414 C open file cnt 26169 min 0.014 ms max 0.176 ms avg 0.021 ms med 0.017 ms std 0.010 D rd 1st byte cnt 26169 min 0.173 ms max 36.930 ms avg 0.522 ms med 0.269 ms std 1.282 E read rate 67.804 MB/s (data) 25.678 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 8662 min 0.001 ms max 11.434 ms avg 0.077 ms med 0.004 ms std 0.667 B lstat file cnt 8109 min 0.007 ms max 11.780 ms avg 0.081 ms med 0.023 ms std 0.644 C open file cnt 6444 min 0.014 ms max 0.280 ms avg 0.021 ms med 0.017 ms std 0.012 D rd 1st byte cnt 6444 min 0.179 ms max 301.081 ms avg 2.586 ms med 0.276 ms std 18.897 E read rate 15.353 MB/s (data) 5.959 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 9417 min 0.035 ms max 4893.706 ms avg 0.747 ms med 0.042 ms std 50.694 G wr 1st byte cnt 9417 min 0.006 ms max 0.291 ms avg 0.007 ms med 0.007 ms std 0.008 H write close cnt 9417 min 0.013 ms max 757.789 ms avg 0.123 ms med 0.019 ms std 7.903 I mkdir cnt 877 min 0.019 ms max 537.174 ms avg 18.051 ms med 0.028 ms std 64.751 J write rate 80.196 MB/s (data) 27.340 MB/s (open + 1st byte + data + close) A read dir cnt 3372 min 0.001 ms max 290.690 ms avg 0.516 ms med 0.004 ms std 7.999 B lstat file cnt 3164 min 0.007 ms max 128.681 ms avg 0.263 ms med 0.023 ms std 3.960 C open file cnt 2538 min 0.014 ms max 0.938 ms avg 0.021 ms med 0.017 ms std 0.021 D rd 1st byte cnt 2538 min 0.181 ms max 757.527 ms avg 7.730 ms med 0.305 ms std 36.780 E read rate 8.487 MB/s (data) 2.212 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35886 min 0.001 ms max 17.192 ms avg 0.053 ms med 0.004 ms std 0.503 B lstat file cnt 33472 min 0.007 ms max 14.182 ms avg 0.051 ms med 0.022 ms std 0.414 C open file cnt 26221 min 0.014 ms max 0.167 ms avg 0.021 ms med 0.017 ms std 0.010 D rd 1st byte cnt 26221 min 0.176 ms max 25.100 ms avg 0.521 ms med 0.264 ms std 1.297 E read rate 68.152 MB/s (data) 25.641 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 8820 min 0.001 ms max 19.873 ms avg 0.093 ms med 0.004 ms std 0.799 B lstat file cnt 8243 min 0.007 ms max 14.714 ms avg 0.082 ms med 0.023 ms std 0.651 C open file cnt 6515 min 0.014 ms max 0.189 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 6515 min 0.179 ms max 229.486 ms avg 2.412 ms med 0.277 ms std 16.543 E read rate 14.148 MB/s (data) 5.970 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 9324 min 0.037 ms max 948.668 ms avg 0.391 ms med 0.042 ms std 12.686 G wr 1st byte cnt 9324 min 0.006 ms max 0.348 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 9324 min 0.013 ms max 359.359 ms avg 0.099 ms med 0.019 ms std 4.490 I mkdir cnt 874 min 0.020 ms max 568.497 ms avg 17.381 ms med 0.028 ms std 61.860 J write rate 38.286 MB/s (data) 25.109 MB/s (open + 1st byte + data + close) A read dir cnt 2284 min 0.001 ms max 254.950 ms avg 0.593 ms med 0.004 ms std 7.748 B lstat file cnt 2145 min 0.007 ms max 207.200 ms avg 0.429 ms med 0.023 ms std 6.700 C open file cnt 1730 min 0.014 ms max 0.268 ms avg 0.021 ms med 0.018 ms std 0.014 D rd 1st byte cnt 1730 min 0.178 ms max 1055.132 ms avg 10.889 ms med 0.321 ms std 48.640 E read rate 4.956 MB/s (data) 1.501 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 33542 min 0.001 ms max 87.004 ms avg 0.056 ms med 0.004 ms std 0.815 B lstat file cnt 31295 min 0.007 ms max 74.856 ms avg 0.051 ms med 0.022 ms std 0.564 C open file cnt 24548 min 0.014 ms max 0.243 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 24548 min 0.177 ms max 93.436 ms avg 0.564 ms med 0.265 ms std 2.184 E read rate 63.163 MB/s (data) 23.863 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11963 min 0.001 ms max 84.817 ms avg 0.110 ms med 0.004 ms std 1.265 B lstat file cnt 11188 min 0.007 ms max 17.486 ms avg 0.086 ms med 0.022 ms std 0.702 C open file cnt 8864 min 0.014 ms max 0.255 ms avg 0.021 ms med 0.017 ms std 0.013 D rd 1st byte cnt 8864 min 0.178 ms max 125.381 ms avg 1.845 ms med 0.286 ms std 7.283 E read rate 22.368 MB/s (data) 8.210 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 10073 min 0.036 ms max 387.052 ms avg 0.231 ms med 0.042 ms std 5.425 G wr 1st byte cnt 10073 min 0.006 ms max 0.338 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 10073 min 0.013 ms max 221.902 ms avg 0.055 ms med 0.019 ms std 2.379 I mkdir cnt 937 min 0.019 ms max 641.404 ms avg 23.793 ms med 0.027 ms std 83.506 J write rate 90.608 MB/s (data) 52.512 MB/s (open + 1st byte + data + close) A read dir cnt 1826 min 0.001 ms max 93.108 ms avg 0.510 ms med 0.004 ms std 4.748 B lstat file cnt 1700 min 0.007 ms max 71.203 ms avg 0.385 ms med 0.022 ms std 4.144 C open file cnt 1322 min 0.014 ms max 0.172 ms avg 0.020 ms med 0.017 ms std 0.011 D rd 1st byte cnt 1322 min 0.176 ms max 810.955 ms avg 13.861 ms med 0.366 ms std 46.097 E read rate 3.388 MB/s (data) 1.136 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35304 min 0.001 ms max 64.090 ms avg 0.052 ms med 0.004 ms std 0.586 B lstat file cnt 32932 min 0.007 ms max 33.617 ms avg 0.053 ms med 0.023 ms std 0.457 C open file cnt 25813 min 0.014 ms max 0.246 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 25813 min 0.173 ms max 103.872 ms avg 0.541 ms med 0.265 ms std 1.738 E read rate 68.851 MB/s (data) 25.283 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11330 min 0.001 ms max 17.896 ms avg 0.087 ms med 0.004 ms std 0.777 B lstat file cnt 10594 min 0.007 ms max 19.139 ms avg 0.089 ms med 0.022 ms std 0.726 C open file cnt 8384 min 0.014 ms max 0.272 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 8384 min 0.180 ms max 229.873 ms avg 1.984 ms med 0.287 ms std 9.027 E read rate 20.556 MB/s (data) 7.671 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 3027 min 0.037 ms max 3328.345 ms avg 1.908 ms med 0.042 ms std 68.502 G wr 1st byte cnt 3027 min 0.006 ms max 0.161 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 3027 min 0.013 ms max 440.019 ms avg 0.185 ms med 0.019 ms std 8.063 I mkdir cnt 298 min 0.020 ms max 8069.578 ms avg 42.828 ms med 0.028 ms std 469.641 J write rate 34.459 MB/s (data) 11.414 MB/s (open + 1st byte + data + close) A read dir cnt 3105 min 0.001 ms max 80.333 ms avg 0.242 ms med 0.004 ms std 2.649 B lstat file cnt 2892 min 0.007 ms max 50.789 ms avg 0.132 ms med 0.023 ms std 1.511 C open file cnt 2252 min 0.014 ms max 7.666 ms avg 0.025 ms med 0.018 ms std 0.164 D rd 1st byte cnt 2252 min 0.183 ms max 8072.890 ms avg 10.214 ms med 0.310 ms std 185.493 E read rate 10.034 MB/s (data) 1.912 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 34013 min 0.001 ms max 78.523 ms avg 0.057 ms med 0.004 ms std 0.735 B lstat file cnt 31728 min 0.007 ms max 51.255 ms avg 0.051 ms med 0.023 ms std 0.478 C open file cnt 24868 min 0.014 ms max 0.237 ms avg 0.021 ms med 0.021 ms std 0.011 D rd 1st byte cnt 24868 min 0.175 ms max 89.210 ms avg 0.537 ms med 0.266 ms std 1.646 E read rate 61.999 MB/s (data) 24.243 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15320 min 0.001 ms max 23.843 ms avg 0.106 ms med 0.003 ms std 0.894 B lstat file cnt 14325 min 0.007 ms max 20.845 ms avg 0.089 ms med 0.022 ms std 0.754 C open file cnt 11339 min 0.014 ms max 0.514 ms avg 0.021 ms med 0.016 ms std 0.018 D rd 1st byte cnt 11339 min 0.175 ms max 25.390 ms avg 1.292 ms med 0.294 ms std 2.914 E read rate 26.352 MB/s (data) 10.639 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 10186 min 0.036 ms max 660.053 ms avg 0.522 ms med 0.042 ms std 12.571 G wr 1st byte cnt 10186 min 0.006 ms max 0.304 ms avg 0.007 ms med 0.006 ms std 0.008 H write close cnt 10186 min 0.013 ms max 1034.082 ms avg 0.295 ms med 0.019 ms std 13.788 I mkdir cnt 958 min 0.019 ms max 883.222 ms avg 16.086 ms med 0.027 ms std 77.705 J write rate 63.835 MB/s (data) 26.440 MB/s (open + 1st byte + data + close) A read dir cnt 837 min 0.001 ms max 1234.526 ms avg 4.204 ms med 0.004 ms std 53.529 B lstat file cnt 786 min 0.007 ms max 83.173 ms avg 0.735 ms med 0.022 ms std 6.313 C open file cnt 625 min 0.014 ms max 0.315 ms avg 0.022 ms med 0.018 ms std 0.017 D rd 1st byte cnt 625 min 0.177 ms max 534.252 ms avg 23.448 ms med 0.436 ms std 66.986 E read rate 1.429 MB/s (data) 0.555 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 32662 min 0.001 ms max 105.761 ms avg 0.059 ms med 0.004 ms std 0.900 B lstat file cnt 30467 min 0.007 ms max 92.914 ms avg 0.053 ms med 0.023 ms std 0.658 C open file cnt 23888 min 0.014 ms max 0.307 ms avg 0.021 ms med 0.021 ms std 0.011 D rd 1st byte cnt 23888 min 0.173 ms max 83.561 ms avg 0.562 ms med 0.268 ms std 1.903 E read rate 59.335 MB/s (data) 23.241 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14960 min 0.001 ms max 24.735 ms avg 0.123 ms med 0.004 ms std 1.050 B lstat file cnt 13991 min 0.007 ms max 25.824 ms avg 0.094 ms med 0.022 ms std 0.815 C open file cnt 11083 min 0.014 ms max 0.380 ms avg 0.021 ms med 0.016 ms std 0.014 D rd 1st byte cnt 11083 min 0.171 ms max 30.985 ms avg 1.317 ms med 0.290 ms std 2.980 E read rate 26.200 MB/s (data) 10.404 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 12391 min 0.036 ms max 642.900 ms avg 0.492 ms med 0.042 ms std 12.486 G wr 1st byte cnt 12391 min 0.006 ms max 0.522 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 12391 min 0.013 ms max 381.920 ms avg 0.058 ms med 0.019 ms std 3.519 I mkdir cnt 1150 min 0.018 ms max 539.186 ms avg 13.938 ms med 0.026 ms std 59.878 J write rate 69.379 MB/s (data) 33.891 MB/s (open + 1st byte + data + close) A read dir cnt 758 min 0.001 ms max 366.832 ms avg 2.029 ms med 0.004 ms std 20.709 B lstat file cnt 711 min 0.007 ms max 352.836 ms avg 1.163 ms med 0.024 ms std 15.732 C open file cnt 568 min 0.015 ms max 0.293 ms avg 0.022 ms med 0.018 ms std 0.016 D rd 1st byte cnt 568 min 0.179 ms max 852.700 ms avg 29.182 ms med 0.959 ms std 74.397 E read rate 1.503 MB/s (data) 0.570 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30346 min 0.001 ms max 81.941 ms avg 0.065 ms med 0.004 ms std 1.090 B lstat file cnt 28283 min 0.007 ms max 91.797 ms avg 0.062 ms med 0.023 ms std 1.067 C open file cnt 22088 min 0.014 ms max 0.245 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 22088 min 0.173 ms max 93.185 ms avg 0.621 ms med 0.274 ms std 2.796 E read rate 56.171 MB/s (data) 21.427 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14286 min 0.001 ms max 83.828 ms avg 0.125 ms med 0.004 ms std 1.495 B lstat file cnt 13361 min 0.007 ms max 114.077 ms avg 0.112 ms med 0.022 ms std 1.325 C open file cnt 10586 min 0.014 ms max 0.461 ms avg 0.022 ms med 0.017 ms std 0.019 D rd 1st byte cnt 10586 min 0.176 ms max 103.824 ms avg 1.387 ms med 0.300 ms std 4.285 E read rate 25.279 MB/s (data) 9.935 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 11717 min 0.035 ms max 617.022 ms avg 0.351 ms med 0.041 ms std 9.199 G wr 1st byte cnt 11717 min 0.006 ms max 0.207 ms avg 0.007 ms med 0.007 ms std 0.006 H write close cnt 11717 min 0.013 ms max 437.446 ms avg 0.121 ms med 0.019 ms std 5.240 I mkdir cnt 1097 min 0.018 ms max 754.942 ms avg 16.516 ms med 0.026 ms std 70.426 J write rate 75.880 MB/s (data) 38.260 MB/s (open + 1st byte + data + close) A read dir cnt 946 min 0.001 ms max 399.245 ms avg 1.885 ms med 0.004 ms std 17.142 B lstat file cnt 880 min 0.007 ms max 612.227 ms avg 1.391 ms med 0.022 ms std 22.116 C open file cnt 681 min 0.015 ms max 0.688 ms avg 0.023 ms med 0.018 ms std 0.032 D rd 1st byte cnt 681 min 0.178 ms max 864.639 ms avg 24.868 ms med 0.880 ms std 64.488 E read rate 1.470 MB/s (data) 0.510 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31020 min 0.001 ms max 76.125 ms avg 0.056 ms med 0.004 ms std 0.736 B lstat file cnt 28920 min 0.007 ms max 41.511 ms avg 0.051 ms med 0.022 ms std 0.451 C open file cnt 22621 min 0.014 ms max 0.425 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 22621 min 0.172 ms max 91.087 ms avg 0.608 ms med 0.266 ms std 2.678 E read rate 55.110 MB/s (data) 21.693 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14746 min 0.001 ms max 94.565 ms avg 0.114 ms med 0.003 ms std 1.223 B lstat file cnt 13795 min 0.007 ms max 21.599 ms avg 0.092 ms med 0.021 ms std 0.774 C open file cnt 10946 min 0.014 ms max 0.426 ms avg 0.021 ms med 0.016 ms std 0.019 D rd 1st byte cnt 10946 min 0.177 ms max 102.376 ms avg 1.405 ms med 0.301 ms std 3.887 E read rate 27.109 MB/s (data) 10.188 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 13495 min 0.036 ms max 401.352 ms avg 0.312 ms med 0.041 ms std 7.591 G wr 1st byte cnt 13495 min 0.006 ms max 1.550 ms avg 0.007 ms med 0.007 ms std 0.016 H write close cnt 13495 min 0.013 ms max 284.957 ms avg 0.088 ms med 0.018 ms std 3.417 I mkdir cnt 1238 min 0.018 ms max 816.738 ms avg 14.090 ms med 0.027 ms std 68.784 J write rate 75.514 MB/s (data) 41.085 MB/s (open + 1st byte + data + close) A read dir cnt 959 min 0.001 ms max 415.832 ms avg 1.368 ms med 0.004 ms std 17.164 B lstat file cnt 898 min 0.007 ms max 199.424 ms avg 0.683 ms med 0.023 ms std 8.484 C open file cnt 711 min 0.015 ms max 0.149 ms avg 0.021 ms med 0.018 ms std 0.013 D rd 1st byte cnt 711 min 0.181 ms max 714.005 ms avg 25.575 ms med 0.734 ms std 70.723 E read rate 1.718 MB/s (data) 0.588 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 32558 min 0.001 ms max 104.089 ms avg 0.058 ms med 0.004 ms std 0.859 B lstat file cnt 30375 min 0.007 ms max 16.970 ms avg 0.052 ms med 0.023 ms std 0.416 C open file cnt 23818 min 0.014 ms max 0.262 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 23818 min 0.177 ms max 102.903 ms avg 0.600 ms med 0.270 ms std 2.595 E read rate 63.867 MB/s (data) 23.085 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11603 min 0.001 ms max 110.672 ms avg 0.118 ms med 0.004 ms std 1.436 B lstat file cnt 10852 min 0.007 ms max 25.388 ms avg 0.095 ms med 0.023 ms std 0.810 C open file cnt 8602 min 0.014 ms max 0.489 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 8602 min 0.177 ms max 219.191 ms avg 1.975 ms med 0.296 ms std 8.276 E read rate 22.962 MB/s (data) 7.909 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 8047 min 0.037 ms max 36963.216 ms avg 4.655 ms med 0.042 ms std 412.027 G wr 1st byte cnt 8047 min 0.006 ms max 0.333 ms avg 0.007 ms med 0.007 ms std 0.009 H write close cnt 8047 min 0.013 ms max 2.868 ms avg 0.021 ms med 0.019 ms std 0.035 I mkdir cnt 750 min 0.020 ms max 719.963 ms avg 27.682 ms med 0.028 ms std 105.373 J write rate 416.121 MB/s (data) 7.971 MB/s (open + 1st byte + data + close) A read dir cnt 5859 min 0.001 ms max 17.949 ms avg 0.112 ms med 0.004 ms std 0.881 B lstat file cnt 5476 min 0.007 ms max 12.863 ms avg 0.094 ms med 0.023 ms std 0.690 C open file cnt 4321 min 0.014 ms max 0.262 ms avg 0.020 ms med 0.017 ms std 0.013 D rd 1st byte cnt 4321 min 0.179 ms max 33229.282 ms avg 11.138 ms med 0.295 ms std 505.793 E read rate 11.183 MB/s (data) 1.880 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 34665 min 0.001 ms max 20.371 ms avg 0.056 ms med 0.004 ms std 0.530 B lstat file cnt 32337 min 0.007 ms max 88.850 ms avg 0.054 ms med 0.023 ms std 0.636 C open file cnt 25342 min 0.014 ms max 0.256 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 25342 min 0.176 ms max 102.723 ms avg 0.551 ms med 0.268 ms std 1.778 E read rate 67.805 MB/s (data) 24.772 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11681 min 0.001 ms max 21.822 ms avg 0.099 ms med 0.004 ms std 0.887 B lstat file cnt 10927 min 0.007 ms max 22.759 ms avg 0.095 ms med 0.023 ms std 0.809 C open file cnt 8663 min 0.014 ms max 0.529 ms avg 0.021 ms med 0.017 ms std 0.015 D rd 1st byte cnt 8663 min 0.180 ms max 138.961 ms avg 2.020 ms med 0.288 ms std 8.211 E read rate 24.266 MB/s (data) 8.029 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1288 min 0.038 ms max 39.411 ms avg 0.114 ms med 0.042 ms std 1.360 G wr 1st byte cnt 1288 min 0.006 ms max 0.194 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 1288 min 0.013 ms max 0.187 ms avg 0.020 ms med 0.019 ms std 0.010 I mkdir cnt 109 min 0.023 ms max 540.761 ms avg 24.218 ms med 0.030 ms std 82.796 J write rate 53.639 MB/s (data) 44.827 MB/s (open + 1st byte + data + close) A read dir cnt 4471 min 0.001 ms max 227.966 ms avg 0.299 ms med 0.004 ms std 5.779 B lstat file cnt 4178 min 0.007 ms max 332.448 ms avg 0.203 ms med 0.023 ms std 5.353 C open file cnt 3298 min 0.014 ms max 0.768 ms avg 0.022 ms med 0.017 ms std 0.026 D rd 1st byte cnt 3298 min 0.179 ms max 516.146 ms avg 5.144 ms med 0.301 ms std 24.924 E read rate 7.878 MB/s (data) 2.881 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 36389 min 0.001 ms max 12.926 ms avg 0.053 ms med 0.004 ms std 0.495 B lstat file cnt 33942 min 0.007 ms max 17.531 ms avg 0.051 ms med 0.022 ms std 0.415 C open file cnt 26596 min 0.014 ms max 0.262 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 26596 min 0.174 ms max 36.859 ms avg 0.519 ms med 0.267 ms std 1.266 E read rate 71.001 MB/s (data) 26.135 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11295 min 0.001 ms max 19.312 ms avg 0.107 ms med 0.004 ms std 0.887 B lstat file cnt 10561 min 0.007 ms max 29.945 ms avg 0.090 ms med 0.022 ms std 0.788 C open file cnt 8360 min 0.014 ms max 0.369 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 8360 min 0.176 ms max 181.474 ms avg 1.910 ms med 0.292 ms std 7.388 E read rate 19.922 MB/s (data) 7.687 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6526 min 0.036 ms max 12.339 ms avg 0.051 ms med 0.042 ms std 0.222 G wr 1st byte cnt 6526 min 0.006 ms max 0.316 ms avg 0.007 ms med 0.007 ms std 0.008 H write close cnt 6526 min 0.013 ms max 1.543 ms avg 0.020 ms med 0.018 ms std 0.024 I mkdir cnt 608 min 0.018 ms max 616.843 ms avg 19.440 ms med 0.026 ms std 79.900 J write rate 428.718 MB/s (data) 229.315 MB/s (open + 1st byte + data + close) A read dir cnt 6627 min 0.001 ms max 18.794 ms avg 0.117 ms med 0.004 ms std 0.952 B lstat file cnt 6184 min 0.007 ms max 26.433 ms avg 0.092 ms med 0.023 ms std 0.756 C open file cnt 4846 min 0.014 ms max 0.306 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 4846 min 0.180 ms max 308.709 ms avg 3.692 ms med 0.295 ms std 20.444 E read rate 11.358 MB/s (data) 4.092 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35350 min 0.001 ms max 15.097 ms avg 0.052 ms med 0.004 ms std 0.495 B lstat file cnt 32974 min 0.007 ms max 13.323 ms avg 0.049 ms med 0.023 ms std 0.370 C open file cnt 25838 min 0.014 ms max 0.261 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 25838 min 0.177 ms max 37.099 ms avg 0.539 ms med 0.267 ms std 1.360 E read rate 67.737 MB/s (data) 25.141 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11718 min 0.001 ms max 27.714 ms avg 0.110 ms med 0.004 ms std 0.984 B lstat file cnt 10962 min 0.007 ms max 20.614 ms avg 0.107 ms med 0.023 ms std 0.880 C open file cnt 8693 min 0.014 ms max 0.742 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 8693 min 0.170 ms max 146.184 ms avg 1.979 ms med 0.296 ms std 7.797 E read rate 24.265 MB/s (data) 8.096 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 22 min 0.040 ms max 0.064 ms avg 0.043 ms med 0.041 ms std 0.005 G wr 1st byte cnt 22 min 0.006 ms max 0.013 ms avg 0.007 ms med 0.007 ms std 0.002 H write close cnt 22 min 0.014 ms max 0.029 ms avg 0.020 ms med 0.020 ms std 0.004 I mkdir cnt 4 min 0.027 ms max 28014.237 ms avg 7003.585 ms med 0.043 ms std 12130.506 J write rate 400.656 MB/s (data) 269.191 MB/s (open + 1st byte + data + close) A read dir cnt 6029 min 0.001 ms max 296.365 ms avg 0.330 ms med 0.004 ms std 6.653 B lstat file cnt 5625 min 0.007 ms max 228.342 ms avg 0.177 ms med 0.023 ms std 3.615 C open file cnt 4408 min 0.014 ms max 1.765 ms avg 0.021 ms med 0.018 ms std 0.029 D rd 1st byte cnt 4408 min 0.180 ms max 26298.368 ms avg 12.358 ms med 0.301 ms std 398.809 E read rate 8.333 MB/s (data) 1.566 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 34364 min 0.001 ms max 10.668 ms avg 0.049 ms med 0.004 ms std 0.441 B lstat file cnt 32053 min 0.007 ms max 18.985 ms avg 0.051 ms med 0.023 ms std 0.411 C open file cnt 25117 min 0.014 ms max 0.290 ms avg 0.021 ms med 0.020 ms std 0.011 D rd 1st byte cnt 25117 min 0.176 ms max 36.922 ms avg 0.542 ms med 0.273 ms std 1.341 E read rate 63.031 MB/s (data) 24.534 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14557 min 0.001 ms max 21.105 ms avg 0.105 ms med 0.003 ms std 0.915 B lstat file cnt 13617 min 0.007 ms max 24.437 ms avg 0.090 ms med 0.022 ms std 0.767 C open file cnt 10796 min 0.014 ms max 0.444 ms avg 0.021 ms med 0.017 ms std 0.015 D rd 1st byte cnt 10796 min 0.173 ms max 29.741 ms avg 1.407 ms med 0.294 ms std 3.209 E read rate 25.717 MB/s (data) 10.033 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 8038 min 0.037 ms max 1025.838 ms avg 0.287 ms med 0.042 ms std 13.230 G wr 1st byte cnt 8038 min 0.006 ms max 0.316 ms avg 0.008 ms med 0.007 ms std 0.011 H write close cnt 8038 min 0.013 ms max 0.642 ms avg 0.021 ms med 0.019 ms std 0.018 I mkdir cnt 749 min 0.018 ms max 4810.319 ms avg 36.914 ms med 0.027 ms std 333.764 J write rate 403.824 MB/s (data) 93.837 MB/s (open + 1st byte + data + close) A read dir cnt 734 min 0.001 ms max 69.017 ms avg 0.237 ms med 0.003 ms std 2.780 B lstat file cnt 688 min 0.007 ms max 67.180 ms avg 0.282 ms med 0.018 ms std 2.959 C open file cnt 549 min 0.015 ms max 0.361 ms avg 0.022 ms med 0.017 ms std 0.025 D rd 1st byte cnt 549 min 0.177 ms max 3864.597 ms avg 36.327 ms med 0.318 ms std 223.173 E read rate 1.356 MB/s (data) 0.479 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 33609 min 0.001 ms max 11.584 ms avg 0.052 ms med 0.004 ms std 0.476 B lstat file cnt 31352 min 0.007 ms max 17.213 ms avg 0.051 ms med 0.023 ms std 0.397 C open file cnt 24573 min 0.014 ms max 0.300 ms avg 0.021 ms med 0.020 ms std 0.011 D rd 1st byte cnt 24573 min 0.174 ms max 36.702 ms avg 0.553 ms med 0.274 ms std 1.381 E read rate 61.067 MB/s (data) 23.925 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14239 min 0.001 ms max 24.349 ms avg 0.122 ms med 0.003 ms std 1.034 B lstat file cnt 13315 min 0.007 ms max 21.647 ms avg 0.102 ms med 0.022 ms std 0.869 C open file cnt 10546 min 0.014 ms max 0.390 ms avg 0.021 ms med 0.017 ms std 0.015 D rd 1st byte cnt 10546 min 0.175 ms max 30.860 ms avg 1.418 ms med 0.298 ms std 3.183 E read rate 25.493 MB/s (data) 9.891 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 10384 min 0.036 ms max 2035.951 ms avg 0.291 ms med 0.042 ms std 20.065 G wr 1st byte cnt 10384 min 0.006 ms max 22.736 ms avg 0.012 ms med 0.007 ms std 0.295 H write close cnt 10384 min 0.012 ms max 0.933 ms avg 0.020 ms med 0.018 ms std 0.018 I mkdir cnt 971 min 0.020 ms max 5208.797 ms avg 27.130 ms med 0.028 ms std 295.649 J write rate 385.295 MB/s (data) 90.383 MB/s (open + 1st byte + data + close) A read dir cnt 1285 min 0.001 ms max 20.690 ms avg 0.140 ms med 0.003 ms std 1.236 B lstat file cnt 1205 min 0.007 ms max 48.846 ms avg 0.105 ms med 0.017 ms std 1.499 C open file cnt 963 min 0.014 ms max 0.304 ms avg 0.020 ms med 0.017 ms std 0.017 D rd 1st byte cnt 963 min 0.179 ms max 3105.891 ms avg 20.735 ms med 0.289 ms std 169.067 E read rate 2.130 MB/s (data) 0.747 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35269 min 0.001 ms max 11.849 ms avg 0.050 ms med 0.004 ms std 0.458 B lstat file cnt 32896 min 0.007 ms max 16.503 ms avg 0.050 ms med 0.023 ms std 0.394 C open file cnt 25772 min 0.014 ms max 0.296 ms avg 0.021 ms med 0.021 ms std 0.011 D rd 1st byte cnt 25772 min 0.175 ms max 36.786 ms avg 0.525 ms med 0.267 ms std 1.287 E read rate 64.811 MB/s (data) 25.130 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14992 min 0.001 ms max 18.157 ms avg 0.102 ms med 0.003 ms std 0.867 B lstat file cnt 14023 min 0.007 ms max 24.575 ms avg 0.108 ms med 0.022 ms std 0.924 C open file cnt 11116 min 0.014 ms max 0.630 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 11116 min 0.178 ms max 34.257 ms avg 1.337 ms med 0.297 ms std 3.039 E read rate 26.460 MB/s (data) 10.437 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 11667 min 0.036 ms max 1168.459 ms avg 0.400 ms med 0.042 ms std 15.136 G wr 1st byte cnt 11667 min 0.006 ms max 42.373 ms avg 0.011 ms med 0.007 ms std 0.392 H write close cnt 11667 min 0.012 ms max 3.848 ms avg 0.021 ms med 0.018 ms std 0.043 I mkdir cnt 1097 min 0.018 ms max 3671.608 ms avg 19.003 ms med 0.026 ms std 198.677 J write rate 209.953 MB/s (data) 61.410 MB/s (open + 1st byte + data + close) A read dir cnt 1696 min 0.001 ms max 249.963 ms avg 0.287 ms med 0.003 ms std 6.180 B lstat file cnt 1595 min 0.007 ms max 138.194 ms avg 0.213 ms med 0.017 ms std 3.654 C open file cnt 1299 min 0.014 ms max 0.192 ms avg 0.019 ms med 0.016 ms std 0.013 D rd 1st byte cnt 1299 min 0.174 ms max 3724.738 ms avg 11.720 ms med 0.286 ms std 125.160 E read rate 2.231 MB/s (data) 1.073 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35190 min 0.001 ms max 16.364 ms avg 0.051 ms med 0.004 ms std 0.478 B lstat file cnt 32823 min 0.007 ms max 10.061 ms avg 0.049 ms med 0.023 ms std 0.375 C open file cnt 25712 min 0.014 ms max 0.336 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 25712 min 0.176 ms max 44.889 ms avg 0.525 ms med 0.266 ms std 1.320 E read rate 64.689 MB/s (data) 25.087 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15235 min 0.001 ms max 24.877 ms avg 0.114 ms med 0.003 ms std 0.978 B lstat file cnt 14251 min 0.007 ms max 24.634 ms avg 0.108 ms med 0.021 ms std 0.901 C open file cnt 11302 min 0.014 ms max 0.544 ms avg 0.021 ms med 0.017 ms std 0.017 D rd 1st byte cnt 11302 min 0.174 ms max 32.560 ms avg 1.328 ms med 0.296 ms std 3.019 E read rate 27.966 MB/s (data) 10.642 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 12313 min 0.036 ms max 399.527 ms avg 0.176 ms med 0.042 ms std 5.471 G wr 1st byte cnt 12313 min 0.006 ms max 0.465 ms avg 0.007 ms med 0.007 ms std 0.009 H write close cnt 12313 min 0.013 ms max 34.792 ms avg 0.025 ms med 0.019 ms std 0.364 I mkdir cnt 1146 min 0.018 ms max 4943.862 ms avg 23.221 ms med 0.026 ms std 259.312 J write rate 383.056 MB/s (data) 123.852 MB/s (open + 1st byte + data + close) A read dir cnt 1243 min 0.001 ms max 20.250 ms avg 0.203 ms med 0.003 ms std 1.466 B lstat file cnt 1172 min 0.007 ms max 399.847 ms avg 0.535 ms med 0.018 ms std 11.741 C open file cnt 962 min 0.014 ms max 0.197 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 962 min 0.181 ms max 3361.812 ms avg 25.126 ms med 0.311 ms std 189.548 E read rate 3.988 MB/s (data) 0.806 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 36114 min 0.001 ms max 19.004 ms avg 0.053 ms med 0.004 ms std 0.495 B lstat file cnt 33685 min 0.007 ms max 15.786 ms avg 0.051 ms med 0.023 ms std 0.403 C open file cnt 26392 min 0.014 ms max 0.263 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 26392 min 0.178 ms max 36.886 ms avg 0.516 ms med 0.268 ms std 1.254 E read rate 68.716 MB/s (data) 25.881 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11376 min 0.001 ms max 24.450 ms avg 0.103 ms med 0.004 ms std 0.904 B lstat file cnt 10638 min 0.007 ms max 15.978 ms avg 0.085 ms med 0.023 ms std 0.683 C open file cnt 8427 min 0.014 ms max 0.435 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 8427 min 0.176 ms max 248.304 ms avg 2.064 ms med 0.297 ms std 9.863 E read rate 22.731 MB/s (data) 7.713 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 12727 min 0.036 ms max 200.323 ms avg 0.146 ms med 0.041 ms std 3.880 G wr 1st byte cnt 12727 min 0.006 ms max 0.311 ms avg 0.007 ms med 0.007 ms std 0.009 H write close cnt 12727 min 0.012 ms max 766.212 ms avg 0.080 ms med 0.018 ms std 6.791 I mkdir cnt 1186 min 0.020 ms max 1156.884 ms avg 18.939 ms med 0.028 ms std 84.442 J write rate 439.895 MB/s (data) 116.742 MB/s (open + 1st byte + data + close) A read dir cnt 6887 min 0.001 ms max 20.516 ms avg 0.135 ms med 0.004 ms std 1.048 B lstat file cnt 6422 min 0.007 ms max 399.908 ms avg 0.346 ms med 0.023 ms std 9.215 C open file cnt 5029 min 0.014 ms max 0.359 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 5029 min 0.179 ms max 318.893 ms avg 3.336 ms med 0.296 ms std 18.819 E read rate 12.968 MB/s (data) 4.524 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35373 min 0.001 ms max 13.776 ms avg 0.052 ms med 0.004 ms std 0.476 B lstat file cnt 32994 min 0.007 ms max 16.287 ms avg 0.052 ms med 0.023 ms std 0.414 C open file cnt 25852 min 0.014 ms max 0.289 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 25852 min 0.176 ms max 36.809 ms avg 0.534 ms med 0.269 ms std 1.336 E read rate 67.593 MB/s (data) 25.260 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11813 min 0.001 ms max 22.733 ms avg 0.101 ms med 0.004 ms std 0.879 B lstat file cnt 11046 min 0.007 ms max 18.953 ms avg 0.098 ms med 0.023 ms std 0.801 C open file cnt 8745 min 0.014 ms max 0.258 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 8745 min 0.180 ms max 143.973 ms avg 1.902 ms med 0.293 ms std 7.628 E read rate 22.562 MB/s (data) 8.113 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 7843 min 0.036 ms max 399.427 ms avg 0.229 ms med 0.042 ms std 6.320 G wr 1st byte cnt 7843 min 0.006 ms max 0.299 ms avg 0.007 ms med 0.006 ms std 0.009 H write close cnt 7843 min 0.012 ms max 0.600 ms avg 0.020 ms med 0.018 ms std 0.017 I mkdir cnt 718 min 0.019 ms max 2191.415 ms avg 27.542 ms med 0.027 ms std 137.121 J write rate 370.503 MB/s (data) 101.914 MB/s (open + 1st byte + data + close) A read dir cnt 5232 min 0.001 ms max 27.015 ms avg 0.134 ms med 0.004 ms std 1.099 B lstat file cnt 4880 min 0.007 ms max 400.164 ms avg 0.238 ms med 0.023 ms std 6.464 C open file cnt 3820 min 0.014 ms max 0.283 ms avg 0.021 ms med 0.017 ms std 0.012 D rd 1st byte cnt 3820 min 0.177 ms max 351.251 ms avg 4.554 ms med 0.301 ms std 23.630 E read rate 9.177 MB/s (data) 3.315 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 36148 min 0.001 ms max 16.407 ms avg 0.053 ms med 0.004 ms std 0.500 B lstat file cnt 33714 min 0.007 ms max 15.702 ms avg 0.051 ms med 0.022 ms std 0.411 C open file cnt 26407 min 0.014 ms max 0.284 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 26407 min 0.178 ms max 36.495 ms avg 0.519 ms med 0.265 ms std 1.276 E read rate 69.737 MB/s (data) 25.933 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11793 min 0.001 ms max 23.846 ms avg 0.104 ms med 0.004 ms std 0.893 B lstat file cnt 11028 min 0.007 ms max 22.982 ms avg 0.094 ms med 0.023 ms std 0.797 C open file cnt 8735 min 0.014 ms max 0.441 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 8735 min 0.179 ms max 218.344 ms avg 1.944 ms med 0.297 ms std 7.891 E read rate 23.606 MB/s (data) 8.150 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5318 min 0.037 ms max 1015.473 ms avg 0.640 ms med 0.042 ms std 18.677 G wr 1st byte cnt 5318 min 0.006 ms max 0.277 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 5318 min 0.012 ms max 0.275 ms avg 0.019 ms med 0.018 ms std 0.014 I mkdir cnt 486 min 0.018 ms max 3168.485 ms avg 45.421 ms med 0.026 ms std 249.943 J write rate 404.343 MB/s (data) 49.888 MB/s (open + 1st byte + data + close) A read dir cnt 3751 min 0.001 ms max 25.827 ms avg 0.153 ms med 0.004 ms std 1.246 B lstat file cnt 3503 min 0.007 ms max 399.187 ms avg 0.343 ms med 0.023 ms std 8.701 C open file cnt 2754 min 0.014 ms max 0.542 ms avg 0.021 ms med 0.018 ms std 0.015 D rd 1st byte cnt 2754 min 0.179 ms max 2205.841 ms avg 6.956 ms med 0.299 ms std 65.539 E read rate 7.826 MB/s (data) 2.450 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35221 min 0.001 ms max 15.015 ms avg 0.052 ms med 0.004 ms std 0.480 B lstat file cnt 32848 min 0.007 ms max 13.475 ms avg 0.051 ms med 0.023 ms std 0.402 C open file cnt 25729 min 0.014 ms max 0.181 ms avg 0.021 ms med 0.017 ms std 0.010 D rd 1st byte cnt 25729 min 0.178 ms max 67.567 ms avg 0.535 ms med 0.268 ms std 1.427 E read rate 66.469 MB/s (data) 25.070 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11249 min 0.001 ms max 31.287 ms avg 0.106 ms med 0.004 ms std 0.959 B lstat file cnt 10517 min 0.007 ms max 93.394 ms avg 0.104 ms med 0.023 ms std 1.189 C open file cnt 8320 min 0.014 ms max 0.246 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 8320 min 0.180 ms max 221.589 ms avg 2.019 ms med 0.287 ms std 9.372 E read rate 21.198 MB/s (data) 7.631 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6879 min 0.036 ms max 127.732 ms avg 0.114 ms med 0.042 ms std 2.146 G wr 1st byte cnt 6879 min 0.006 ms max 0.164 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 6879 min 0.013 ms max 0.466 ms avg 0.019 ms med 0.018 ms std 0.012 I mkdir cnt 647 min 0.018 ms max 4276.842 ms avg 46.274 ms med 0.025 ms std 266.240 J write rate 461.830 MB/s (data) 173.492 MB/s (open + 1st byte + data + close) A read dir cnt 4920 min 0.001 ms max 442.370 ms avg 0.305 ms med 0.004 ms std 8.590 B lstat file cnt 4591 min 0.007 ms max 399.866 ms avg 0.387 ms med 0.023 ms std 9.827 C open file cnt 3609 min 0.014 ms max 3.028 ms avg 0.022 ms med 0.017 ms std 0.052 D rd 1st byte cnt 3609 min 0.182 ms max 1002.113 ms avg 4.663 ms med 0.299 ms std 31.500 E read rate 7.965 MB/s (data) 3.027 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31288 min 0.001 ms max 24.701 ms avg 0.055 ms med 0.004 ms std 0.545 B lstat file cnt 29150 min 0.007 ms max 16.480 ms avg 0.052 ms med 0.023 ms std 0.425 C open file cnt 22739 min 0.014 ms max 0.297 ms avg 0.021 ms med 0.020 ms std 0.011 D rd 1st byte cnt 22739 min 0.175 ms max 533.464 ms avg 0.617 ms med 0.274 ms std 3.874 E read rate 57.411 MB/s (data) 21.993 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14977 min 0.001 ms max 21.739 ms avg 0.112 ms med 0.004 ms std 0.927 B lstat file cnt 14011 min 0.007 ms max 21.892 ms avg 0.098 ms med 0.022 ms std 0.837 C open file cnt 11116 min 0.014 ms max 0.386 ms avg 0.021 ms med 0.016 ms std 0.015 D rd 1st byte cnt 11116 min 0.173 ms max 70.295 ms avg 1.366 ms med 0.293 ms std 3.208 E read rate 27.258 MB/s (data) 10.392 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1143 min 0.036 ms max 1072.998 ms avg 1.626 ms med 0.043 ms std 38.353 G wr 1st byte cnt 1143 min 0.006 ms max 0.156 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 1143 min 0.013 ms max 0.104 ms avg 0.020 ms med 0.019 ms std 0.007 I mkdir cnt 91 min 0.018 ms max 3882.065 ms avg 323.186 ms med 0.028 ms std 823.554 J write rate 415.499 MB/s (data) 18.668 MB/s (open + 1st byte + data + close) A read dir cnt 18 min 0.003 ms max 494.043 ms avg 27.452 ms med 0.006 ms std 113.165 B lstat file cnt 17 min 0.021 ms max 740.104 ms avg 43.566 ms med 0.030 ms std 174.135 C open file cnt 16 min 0.020 ms max 0.107 ms avg 0.028 ms med 0.022 ms std 0.021 D rd 1st byte cnt 16 min 549.262 ms max 2557.703 ms avg 1165.951 ms med 1134.484 ms std 491.805 E read rate 0.042 MB/s (data) 0.018 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 33751 min 0.001 ms max 12.660 ms avg 0.053 ms med 0.004 ms std 0.488 B lstat file cnt 31487 min 0.007 ms max 20.029 ms avg 0.052 ms med 0.023 ms std 0.429 C open file cnt 24687 min 0.014 ms max 0.264 ms avg 0.021 ms med 0.020 ms std 0.011 D rd 1st byte cnt 24687 min 0.176 ms max 85.903 ms avg 0.551 ms med 0.270 ms std 1.770 E read rate 62.402 MB/s (data) 24.105 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14781 min 0.001 ms max 79.632 ms avg 0.111 ms med 0.003 ms std 1.091 B lstat file cnt 13826 min 0.007 ms max 21.097 ms avg 0.095 ms med 0.021 ms std 0.808 C open file cnt 10965 min 0.014 ms max 0.472 ms avg 0.021 ms med 0.016 ms std 0.016 D rd 1st byte cnt 10965 min 0.176 ms max 106.774 ms avg 1.352 ms med 0.295 ms std 3.420 E read rate 25.827 MB/s (data) 10.232 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1098 min 0.036 ms max 1205.085 ms avg 2.314 ms med 0.041 ms std 45.529 G wr 1st byte cnt 1098 min 0.006 ms max 0.066 ms avg 0.007 ms med 0.007 ms std 0.002 H write close cnt 1098 min 0.012 ms max 1.253 ms avg 0.020 ms med 0.017 ms std 0.044 I mkdir cnt 96 min 0.018 ms max 4602.992 ms avg 263.702 ms med 0.025 ms std 793.106 J write rate 469.839 MB/s (data) 16.359 MB/s (open + 1st byte + data + close) A read dir cnt 15 min 0.002 ms max 1306.370 ms avg 87.096 ms med 0.006 ms std 325.865 B lstat file cnt 15 min 0.023 ms max 1902.862 ms avg 257.728 ms med 0.026 ms std 561.059 C open file cnt 13 min 0.020 ms max 0.044 ms avg 0.024 ms med 0.021 ms std 0.006 D rd 1st byte cnt 13 min 591.007 ms max 1448.838 ms avg 944.598 ms med 900.714 ms std 283.303 E read rate 0.052 MB/s (data) 0.025 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 33424 min 0.001 ms max 94.042 ms avg 0.059 ms med 0.004 ms std 0.738 B lstat file cnt 31175 min 0.007 ms max 44.930 ms avg 0.055 ms med 0.023 ms std 0.495 C open file cnt 24423 min 0.014 ms max 0.269 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 24423 min 0.175 ms max 90.308 ms avg 0.546 ms med 0.269 ms std 1.607 E read rate 61.116 MB/s (data) 23.828 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14734 min 0.001 ms max 21.403 ms avg 0.112 ms med 0.003 ms std 0.950 B lstat file cnt 13782 min 0.007 ms max 24.982 ms avg 0.097 ms med 0.022 ms std 0.841 C open file cnt 10928 min 0.014 ms max 0.268 ms avg 0.021 ms med 0.017 ms std 0.012 D rd 1st byte cnt 10928 min 0.176 ms max 25.898 ms avg 1.322 ms med 0.293 ms std 2.976 E read rate 24.880 MB/s (data) 10.201 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 53 min 0.037 ms max 16.280 ms avg 0.347 ms med 0.040 ms std 2.209 G wr 1st byte cnt 53 min 0.006 ms max 0.062 ms avg 0.008 ms med 0.006 ms std 0.009 H write close cnt 53 min 0.013 ms max 0.075 ms avg 0.017 ms med 0.017 ms std 0.008 I mkdir cnt 3 min 0.021 ms max 0.029 ms avg 0.024 ms med 0.022 ms std 0.004 J write rate 537.491 MB/s (data) 131.606 MB/s (open + 1st byte + data + close) A read dir cnt 3 min 0.004 ms max 0.006 ms avg 0.005 ms med 0.006 ms std 0.001 B lstat file cnt 3 min 0.026 ms max 0.038 ms avg 0.032 ms med 0.032 ms std 0.005 C open file cnt 3 min 0.021 ms max 0.047 ms avg 0.030 ms med 0.021 ms std 0.012 D rd 1st byte cnt 3 min 407.725 ms max 28577.171 ms avg 11302.710 ms med 4923.233 ms std 12353.210 E read rate 0.016 MB/s (data) 0.002 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 34450 min 0.001 ms max 15.602 ms avg 0.055 ms med 0.004 ms std 0.507 B lstat file cnt 32138 min 0.007 ms max 16.973 ms avg 0.053 ms med 0.023 ms std 0.422 C open file cnt 25192 min 0.014 ms max 0.190 ms avg 0.021 ms med 0.021 ms std 0.011 D rd 1st byte cnt 25192 min 0.177 ms max 15.937 ms avg 0.533 ms med 0.267 ms std 1.313 E read rate 63.480 MB/s (data) 24.646 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14869 min 0.001 ms max 29.818 ms avg 0.113 ms med 0.003 ms std 0.974 B lstat file cnt 13907 min 0.007 ms max 31.088 ms avg 0.099 ms med 0.022 ms std 0.853 C open file cnt 11027 min 0.014 ms max 0.365 ms avg 0.021 ms med 0.016 ms std 0.016 D rd 1st byte cnt 11027 min 0.175 ms max 35.427 ms avg 1.369 ms med 0.295 ms std 3.096 E read rate 26.727 MB/s (data) 10.278 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 65 min 0.040 ms max 0.052 ms avg 0.043 ms med 0.042 ms std 0.003 G wr 1st byte cnt 65 min 0.006 ms max 0.007 ms avg 0.006 ms med 0.006 ms std 0.001 H write close cnt 65 min 0.013 ms max 0.030 ms avg 0.018 ms med 0.019 ms std 0.003 I mkdir cnt 7 min 0.023 ms max 0.039 ms avg 0.030 ms med 0.027 ms std 0.006 J write rate 427.161 MB/s (data) 215.959 MB/s (open + 1st byte + data + close) A read dir cnt 2 min 0.005 ms max 0.005 ms avg 0.005 ms med 0.005 ms std 0.000 B lstat file cnt 2 min 0.026 ms max 0.040 ms avg 0.033 ms med 0.040 ms std 0.007 C open file cnt 2 min 0.022 ms max 0.141 ms avg 0.081 ms med 0.141 ms std 0.059 D rd 1st byte cnt 2 min 730.747 ms max 11092.337 ms avg 5911.542 ms med 11092.337 ms std 5180.795 E read rate 0.024 MB/s (data) 0.001 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 33851 min 0.001 ms max 75.641 ms avg 0.055 ms med 0.004 ms std 0.647 B lstat file cnt 31584 min 0.007 ms max 34.145 ms avg 0.053 ms med 0.023 ms std 0.457 C open file cnt 24786 min 0.014 ms max 0.310 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 24786 min 0.177 ms max 81.707 ms avg 0.558 ms med 0.270 ms std 1.673 E read rate 64.418 MB/s (data) 24.227 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11717 min 0.001 ms max 48.951 ms avg 0.103 ms med 0.004 ms std 1.027 B lstat file cnt 10961 min 0.007 ms max 20.331 ms avg 0.089 ms med 0.022 ms std 0.747 C open file cnt 8693 min 0.014 ms max 0.297 ms avg 0.021 ms med 0.017 ms std 0.013 D rd 1st byte cnt 8693 min 0.179 ms max 140.535 ms avg 1.967 ms med 0.295 ms std 8.025 E read rate 23.357 MB/s (data) 8.037 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 848 min 0.036 ms max 1.798 ms avg 0.050 ms med 0.042 ms std 0.077 G wr 1st byte cnt 848 min 0.006 ms max 0.078 ms avg 0.007 ms med 0.006 ms std 0.003 H write close cnt 848 min 0.013 ms max 0.205 ms avg 0.020 ms med 0.019 ms std 0.010 I mkdir cnt 79 min 0.020 ms max 520.043 ms avg 41.561 ms med 0.026 ms std 128.936 J write rate 1.379 MB/s (data) 1.375 MB/s (open + 1st byte + data + close) A read dir cnt 6995 min 0.001 ms max 14.499 ms avg 0.104 ms med 0.004 ms std 0.835 B lstat file cnt 6537 min 0.007 ms max 21.959 ms avg 0.109 ms med 0.023 ms std 0.861 C open file cnt 5163 min 0.014 ms max 2.029 ms avg 0.021 ms med 0.017 ms std 0.030 D rd 1st byte cnt 5163 min 0.181 ms max 331.103 ms avg 3.917 ms med 0.293 ms std 22.136 E read rate 11.762 MB/s (data) 3.987 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 36079 min 0.001 ms max 11.477 ms avg 0.051 ms med 0.004 ms std 0.467 B lstat file cnt 33649 min 0.007 ms max 15.737 ms avg 0.049 ms med 0.022 ms std 0.389 C open file cnt 26361 min 0.014 ms max 0.200 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 26361 min 0.177 ms max 36.712 ms avg 0.529 ms med 0.265 ms std 1.311 E read rate 69.956 MB/s (data) 25.797 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11820 min 0.001 ms max 20.249 ms avg 0.096 ms med 0.004 ms std 0.874 B lstat file cnt 11053 min 0.007 ms max 20.508 ms avg 0.091 ms med 0.023 ms std 0.780 C open file cnt 8754 min 0.014 ms max 0.547 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 8754 min 0.180 ms max 149.086 ms avg 1.799 ms med 0.289 ms std 6.977 E read rate 20.667 MB/s (data) 8.127 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1034 min 0.037 ms max 0.601 ms avg 0.050 ms med 0.042 ms std 0.040 G wr 1st byte cnt 1034 min 0.006 ms max 0.142 ms avg 0.008 ms med 0.007 ms std 0.009 H write close cnt 1034 min 0.013 ms max 0.335 ms avg 0.022 ms med 0.019 ms std 0.022 I mkdir cnt 92 min 0.022 ms max 627.125 ms avg 53.017 ms med 0.030 ms std 140.611 J write rate 6.860 MB/s (data) 6.760 MB/s (open + 1st byte + data + close) A read dir cnt 7649 min 0.001 ms max 19.841 ms avg 0.116 ms med 0.004 ms std 0.969 B lstat file cnt 7139 min 0.007 ms max 15.182 ms avg 0.093 ms med 0.023 ms std 0.724 C open file cnt 5609 min 0.014 ms max 3.257 ms avg 0.022 ms med 0.018 ms std 0.049 D rd 1st byte cnt 5609 min 0.179 ms max 595.627 ms avg 3.878 ms med 0.292 ms std 23.877 E read rate 15.115 MB/s (data) 4.294 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35490 min 0.001 ms max 10.707 ms avg 0.053 ms med 0.004 ms std 0.483 B lstat file cnt 33108 min 0.007 ms max 12.904 ms avg 0.051 ms med 0.023 ms std 0.404 C open file cnt 25963 min 0.014 ms max 0.263 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 25963 min 0.177 ms max 16.455 ms avg 0.527 ms med 0.270 ms std 1.275 E read rate 67.302 MB/s (data) 25.374 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11519 min 0.001 ms max 19.733 ms avg 0.095 ms med 0.004 ms std 0.842 B lstat file cnt 10772 min 0.007 ms max 19.315 ms avg 0.093 ms med 0.023 ms std 0.775 C open file cnt 8534 min 0.014 ms max 0.258 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 8534 min 0.179 ms max 125.365 ms avg 2.013 ms med 0.293 ms std 7.776 E read rate 22.687 MB/s (data) 7.870 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1155 min 0.037 ms max 25.966 ms avg 0.076 ms med 0.042 ms std 0.825 G wr 1st byte cnt 1155 min 0.006 ms max 0.046 ms avg 0.007 ms med 0.007 ms std 0.001 H write close cnt 1155 min 0.013 ms max 0.181 ms avg 0.021 ms med 0.019 ms std 0.011 I mkdir cnt 104 min 0.021 ms max 723.215 ms avg 47.852 ms med 0.028 ms std 144.980 J write rate 1.824 MB/s (data) 1.815 MB/s (open + 1st byte + data + close) A read dir cnt 6258 min 0.001 ms max 14.675 ms avg 0.116 ms med 0.004 ms std 0.894 B lstat file cnt 5845 min 0.007 ms max 42.070 ms avg 0.128 ms med 0.023 ms std 1.208 C open file cnt 4602 min 0.014 ms max 0.337 ms avg 0.021 ms med 0.018 ms std 0.012 D rd 1st byte cnt 4602 min 0.176 ms max 324.804 ms avg 4.045 ms med 0.287 ms std 24.166 E read rate 11.524 MB/s (data) 3.839 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35851 min 0.001 ms max 18.754 ms avg 0.051 ms med 0.004 ms std 0.476 B lstat file cnt 33436 min 0.007 ms max 15.987 ms avg 0.049 ms med 0.022 ms std 0.389 C open file cnt 26188 min 0.014 ms max 0.251 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 26188 min 0.178 ms max 36.923 ms avg 0.527 ms med 0.267 ms std 1.314 E read rate 68.289 MB/s (data) 25.561 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 12162 min 0.001 ms max 17.217 ms avg 0.096 ms med 0.004 ms std 0.837 B lstat file cnt 11378 min 0.007 ms max 16.961 ms avg 0.085 ms med 0.023 ms std 0.685 C open file cnt 9026 min 0.014 ms max 0.338 ms avg 0.021 ms med 0.017 ms std 0.013 D rd 1st byte cnt 9026 min 0.180 ms max 116.919 ms avg 1.789 ms med 0.291 ms std 7.038 E read rate 22.087 MB/s (data) 8.361 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 733 min 0.036 ms max 4172.070 ms avg 5.755 ms med 0.042 ms std 153.992 G wr 1st byte cnt 733 min 0.006 ms max 0.075 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 733 min 0.013 ms max 0.156 ms avg 0.021 ms med 0.019 ms std 0.012 I mkdir cnt 73 min 0.020 ms max 730.994 ms avg 35.208 ms med 0.028 ms std 121.114 J write rate 397.083 MB/s (data) 6.194 MB/s (open + 1st byte + data + close) A read dir cnt 8016 min 0.001 ms max 258.562 ms avg 0.140 ms med 0.004 ms std 3.025 B lstat file cnt 7483 min 0.007 ms max 40.082 ms avg 0.095 ms med 0.023 ms std 0.871 C open file cnt 5884 min 0.014 ms max 2.304 ms avg 0.021 ms med 0.018 ms std 0.033 D rd 1st byte cnt 5884 min 0.179 ms max 323.214 ms avg 3.310 ms med 0.289 ms std 19.558 E read rate 13.236 MB/s (data) 4.549 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 34553 min 0.001 ms max 16.424 ms avg 0.053 ms med 0.004 ms std 0.484 B lstat file cnt 32230 min 0.007 ms max 17.104 ms avg 0.051 ms med 0.023 ms std 0.401 C open file cnt 25254 min 0.014 ms max 0.311 ms avg 0.021 ms med 0.021 ms std 0.011 D rd 1st byte cnt 25254 min 0.176 ms max 36.978 ms avg 0.528 ms med 0.267 ms std 1.309 E read rate 62.625 MB/s (data) 24.684 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14963 min 0.001 ms max 21.590 ms avg 0.109 ms med 0.004 ms std 0.936 B lstat file cnt 13993 min 0.007 ms max 23.607 ms avg 0.097 ms med 0.022 ms std 0.831 C open file cnt 11087 min 0.014 ms max 0.449 ms avg 0.021 ms med 0.017 ms std 0.017 D rd 1st byte cnt 11087 min 0.174 ms max 33.558 ms avg 1.375 ms med 0.293 ms std 3.164 E read rate 27.390 MB/s (data) 10.429 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 14291 min 0.036 ms max 653.929 ms avg 0.308 ms med 0.042 ms std 8.698 G wr 1st byte cnt 14291 min 0.006 ms max 0.318 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 14291 min 0.013 ms max 521.866 ms avg 0.128 ms med 0.019 ms std 7.402 I mkdir cnt 1327 min 0.019 ms max 1252.477 ms avg 9.807 ms med 0.029 ms std 65.679 J write rate 54.367 MB/s (data) 32.693 MB/s (open + 1st byte + data + close) A read dir cnt 3292 min 0.001 ms max 464.630 ms avg 0.833 ms med 0.003 ms std 13.341 B lstat file cnt 3070 min 0.007 ms max 801.824 ms avg 0.701 ms med 0.018 ms std 15.786 C open file cnt 2396 min 0.015 ms max 0.203 ms avg 0.020 ms med 0.017 ms std 0.012 D rd 1st byte cnt 2396 min 0.176 ms max 455.704 ms avg 6.870 ms med 0.317 ms std 32.318 E read rate 6.910 MB/s (data) 2.156 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 34415 min 0.001 ms max 16.370 ms avg 0.051 ms med 0.004 ms std 0.476 B lstat file cnt 32100 min 0.007 ms max 12.979 ms avg 0.050 ms med 0.022 ms std 0.386 C open file cnt 25150 min 0.014 ms max 0.276 ms avg 0.021 ms med 0.021 ms std 0.011 D rd 1st byte cnt 25150 min 0.175 ms max 36.781 ms avg 0.539 ms med 0.268 ms std 1.340 E read rate 62.896 MB/s (data) 24.534 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15105 min 0.001 ms max 21.633 ms avg 0.110 ms med 0.003 ms std 0.968 B lstat file cnt 14124 min 0.007 ms max 21.873 ms avg 0.093 ms med 0.021 ms std 0.772 C open file cnt 11188 min 0.014 ms max 0.606 ms avg 0.021 ms med 0.016 ms std 0.020 D rd 1st byte cnt 11188 min 0.175 ms max 32.501 ms avg 1.330 ms med 0.299 ms std 3.028 E read rate 26.694 MB/s (data) 10.492 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 16327 min 0.036 ms max 589.611 ms avg 0.384 ms med 0.042 ms std 11.427 G wr 1st byte cnt 16327 min 0.006 ms max 36.323 ms avg 0.009 ms med 0.007 ms std 0.284 H write close cnt 16327 min 0.013 ms max 351.957 ms avg 0.055 ms med 0.019 ms std 3.241 I mkdir cnt 1522 min 0.019 ms max 1005.036 ms avg 8.947 ms med 0.027 ms std 57.968 J write rate 73.471 MB/s (data) 38.528 MB/s (open + 1st byte + data + close) A read dir cnt 4088 min 0.001 ms max 391.852 ms avg 0.355 ms med 0.003 ms std 7.846 B lstat file cnt 3822 min 0.007 ms max 174.169 ms avg 0.246 ms med 0.018 ms std 4.228 C open file cnt 3017 min 0.014 ms max 0.398 ms avg 0.021 ms med 0.017 ms std 0.018 D rd 1st byte cnt 3017 min 0.176 ms max 660.861 ms avg 5.775 ms med 0.300 ms std 31.365 E read rate 7.196 MB/s (data) 2.529 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35180 min 0.001 ms max 12.842 ms avg 0.051 ms med 0.004 ms std 0.470 B lstat file cnt 32813 min 0.007 ms max 15.523 ms avg 0.051 ms med 0.023 ms std 0.399 C open file cnt 25703 min 0.014 ms max 0.321 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 25703 min 0.176 ms max 36.909 ms avg 0.521 ms med 0.267 ms std 1.291 E read rate 64.270 MB/s (data) 25.109 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15394 min 0.001 ms max 35.355 ms avg 0.113 ms med 0.003 ms std 0.992 B lstat file cnt 14394 min 0.007 ms max 22.066 ms avg 0.095 ms med 0.021 ms std 0.791 C open file cnt 11395 min 0.014 ms max 0.487 ms avg 0.021 ms med 0.017 ms std 0.019 D rd 1st byte cnt 11395 min 0.174 ms max 30.540 ms avg 1.286 ms med 0.294 ms std 3.049 E read rate 27.065 MB/s (data) 10.727 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 13828 min 0.036 ms max 647.198 ms avg 0.421 ms med 0.042 ms std 11.675 G wr 1st byte cnt 13828 min 0.006 ms max 2.350 ms avg 0.008 ms med 0.007 ms std 0.022 H write close cnt 13828 min 0.013 ms max 586.943 ms avg 0.064 ms med 0.019 ms std 4.993 I mkdir cnt 1287 min 0.019 ms max 1018.698 ms avg 10.677 ms med 0.027 ms std 67.450 J write rate 58.158 MB/s (data) 32.786 MB/s (open + 1st byte + data + close) A read dir cnt 3745 min 0.001 ms max 221.606 ms avg 0.296 ms med 0.003 ms std 5.053 B lstat file cnt 3496 min 0.007 ms max 99.442 ms avg 0.169 ms med 0.018 ms std 2.314 C open file cnt 2748 min 0.014 ms max 3.999 ms avg 0.022 ms med 0.017 ms std 0.077 D rd 1st byte cnt 2748 min 0.178 ms max 673.087 ms avg 7.090 ms med 0.303 ms std 38.016 E read rate 7.506 MB/s (data) 2.250 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 34430 min 0.001 ms max 25.950 ms avg 0.052 ms med 0.004 ms std 0.486 B lstat file cnt 32119 min 0.007 ms max 19.626 ms avg 0.052 ms med 0.023 ms std 0.423 C open file cnt 25184 min 0.014 ms max 0.660 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 25184 min 0.176 ms max 29.286 ms avg 0.540 ms med 0.266 ms std 1.361 E read rate 63.907 MB/s (data) 24.635 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15001 min 0.001 ms max 18.370 ms avg 0.102 ms med 0.003 ms std 0.872 B lstat file cnt 14030 min 0.007 ms max 17.964 ms avg 0.088 ms med 0.022 ms std 0.741 C open file cnt 11117 min 0.014 ms max 0.489 ms avg 0.021 ms med 0.017 ms std 0.015 D rd 1st byte cnt 11117 min 0.175 ms max 56.204 ms avg 1.320 ms med 0.294 ms std 3.044 E read rate 25.510 MB/s (data) 10.402 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 18601 min 0.036 ms max 936.972 ms avg 0.447 ms med 0.042 ms std 14.643 G wr 1st byte cnt 18601 min 0.006 ms max 42.140 ms avg 0.010 ms med 0.007 ms std 0.309 H write close cnt 18601 min 0.013 ms max 579.471 ms avg 0.110 ms med 0.018 ms std 6.833 I mkdir cnt 1711 min 0.018 ms max 912.732 ms avg 6.363 ms med 0.028 ms std 51.794 J write rate 85.349 MB/s (data) 36.039 MB/s (open + 1st byte + data + close) A read dir cnt 3696 min 0.001 ms max 533.263 ms avg 0.565 ms med 0.003 ms std 12.029 B lstat file cnt 3449 min 0.007 ms max 99.159 ms avg 0.210 ms med 0.018 ms std 2.540 C open file cnt 2705 min 0.015 ms max 2.942 ms avg 0.022 ms med 0.017 ms std 0.058 D rd 1st byte cnt 2705 min 0.176 ms max 664.069 ms avg 6.381 ms med 0.304 ms std 35.634 E read rate 6.264 MB/s (data) 2.182 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 33964 min 0.001 ms max 84.159 ms avg 0.056 ms med 0.004 ms std 0.666 B lstat file cnt 31685 min 0.007 ms max 19.915 ms avg 0.051 ms med 0.022 ms std 0.402 C open file cnt 24842 min 0.014 ms max 0.677 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 24842 min 0.175 ms max 90.800 ms avg 0.560 ms med 0.270 ms std 1.631 E read rate 64.667 MB/s (data) 24.137 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11299 min 0.001 ms max 20.214 ms avg 0.099 ms med 0.004 ms std 0.866 B lstat file cnt 10563 min 0.007 ms max 87.001 ms avg 0.112 ms med 0.022 ms std 1.424 C open file cnt 8357 min 0.014 ms max 0.430 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 8357 min 0.176 ms max 216.665 ms avg 2.171 ms med 0.290 ms std 10.698 E read rate 25.330 MB/s (data) 7.764 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 11669 min 0.036 ms max 25.387 ms avg 0.072 ms med 0.042 ms std 0.590 G wr 1st byte cnt 11669 min 0.006 ms max 0.637 ms avg 0.008 ms med 0.007 ms std 0.010 H write close cnt 11669 min 0.013 ms max 0.354 ms avg 0.020 ms med 0.019 ms std 0.015 I mkdir cnt 1096 min 0.021 ms max 685.149 ms avg 24.203 ms med 0.029 ms std 94.218 J write rate 280.469 MB/s (data) 162.076 MB/s (open + 1st byte + data + close) A read dir cnt 7364 min 0.001 ms max 50.615 ms avg 0.115 ms med 0.004 ms std 1.068 B lstat file cnt 6884 min 0.007 ms max 51.400 ms avg 0.118 ms med 0.023 ms std 1.068 C open file cnt 5446 min 0.014 ms max 1.265 ms avg 0.021 ms med 0.017 ms std 0.022 D rd 1st byte cnt 5446 min 0.180 ms max 324.864 ms avg 3.516 ms med 0.294 ms std 19.900 E read rate 16.190 MB/s (data) 4.828 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 35522 min 0.001 ms max 54.983 ms avg 0.055 ms med 0.004 ms std 0.580 B lstat file cnt 33138 min 0.007 ms max 43.565 ms avg 0.051 ms med 0.023 ms std 0.447 C open file cnt 25983 min 0.014 ms max 0.674 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 25983 min 0.176 ms max 90.059 ms avg 0.528 ms med 0.265 ms std 1.496 E read rate 68.232 MB/s (data) 25.433 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11725 min 0.001 ms max 87.943 ms avg 0.106 ms med 0.004 ms std 1.186 B lstat file cnt 10963 min 0.007 ms max 15.608 ms avg 0.090 ms med 0.023 ms std 0.723 C open file cnt 8679 min 0.014 ms max 0.309 ms avg 0.021 ms med 0.017 ms std 0.015 D rd 1st byte cnt 8679 min 0.176 ms max 111.164 ms avg 1.880 ms med 0.295 ms std 7.363 E read rate 21.583 MB/s (data) 8.024 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 9806 min 0.036 ms max 18.261 ms avg 0.059 ms med 0.042 ms std 0.379 G wr 1st byte cnt 9806 min 0.006 ms max 0.195 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 9806 min 0.013 ms max 0.311 ms avg 0.020 ms med 0.019 ms std 0.012 I mkdir cnt 908 min 0.020 ms max 718.632 ms avg 30.648 ms med 0.028 ms std 106.214 J write rate 432.148 MB/s (data) 213.089 MB/s (open + 1st byte + data + close) A read dir cnt 7429 min 0.001 ms max 29.782 ms avg 0.111 ms med 0.004 ms std 0.999 B lstat file cnt 6938 min 0.007 ms max 22.662 ms avg 0.092 ms med 0.023 ms std 0.751 C open file cnt 5461 min 0.014 ms max 0.413 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 5461 min 0.180 ms max 320.827 ms avg 3.687 ms med 0.289 ms std 21.182 E read rate 16.790 MB/s (data) 4.576 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 33529 min 0.001 ms max 46.927 ms avg 0.056 ms med 0.004 ms std 0.579 B lstat file cnt 31277 min 0.007 ms max 69.464 ms avg 0.052 ms med 0.023 ms std 0.544 C open file cnt 24515 min 0.014 ms max 0.687 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 24515 min 0.177 ms max 90.528 ms avg 0.574 ms med 0.267 ms std 2.074 E read rate 64.525 MB/s (data) 23.841 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11184 min 0.001 ms max 23.547 ms avg 0.107 ms med 0.004 ms std 0.940 B lstat file cnt 10455 min 0.007 ms max 25.928 ms avg 0.085 ms med 0.023 ms std 0.705 C open file cnt 8268 min 0.014 ms max 0.338 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 8268 min 0.176 ms max 172.337 ms avg 2.132 ms med 0.288 ms std 9.068 E read rate 23.056 MB/s (data) 7.588 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 11286 min 0.037 ms max 33.878 ms avg 0.062 ms med 0.043 ms std 0.482 G wr 1st byte cnt 11286 min 0.006 ms max 1.098 ms avg 0.007 ms med 0.007 ms std 0.013 H write close cnt 11286 min 0.014 ms max 4.341 ms avg 0.021 ms med 0.019 ms std 0.043 I mkdir cnt 1054 min 0.021 ms max 722.626 ms avg 26.117 ms med 0.029 ms std 99.373 J write rate 406.438 MB/s (data) 204.042 MB/s (open + 1st byte + data + close) A read dir cnt 7945 min 0.001 ms max 19.871 ms avg 0.106 ms med 0.004 ms std 0.895 B lstat file cnt 7417 min 0.007 ms max 56.388 ms avg 0.107 ms med 0.024 ms std 1.100 C open file cnt 5834 min 0.014 ms max 0.416 ms avg 0.021 ms med 0.017 ms std 0.012 D rd 1st byte cnt 5834 min 0.179 ms max 310.990 ms avg 2.885 ms med 0.289 ms std 17.824 E read rate 13.018 MB/s (data) 4.979 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 34035 min 0.001 ms max 91.753 ms avg 0.056 ms med 0.004 ms std 0.785 B lstat file cnt 31748 min 0.007 ms max 18.992 ms avg 0.050 ms med 0.023 ms std 0.401 C open file cnt 24884 min 0.014 ms max 0.296 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 24884 min 0.177 ms max 75.509 ms avg 0.551 ms med 0.266 ms std 1.665 E read rate 63.358 MB/s (data) 24.165 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 11595 min 0.001 ms max 65.502 ms avg 0.123 ms med 0.004 ms std 1.268 B lstat file cnt 10845 min 0.007 ms max 17.821 ms avg 0.091 ms med 0.023 ms std 0.750 C open file cnt 8600 min 0.014 ms max 0.459 ms avg 0.021 ms med 0.017 ms std 0.015 D rd 1st byte cnt 8600 min 0.179 ms max 157.992 ms avg 1.965 ms med 0.292 ms std 7.864 E read rate 23.061 MB/s (data) 7.928 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 11572 min 0.036 ms max 25.124 ms avg 0.064 ms med 0.042 ms std 0.483 G wr 1st byte cnt 11572 min 0.006 ms max 0.245 ms avg 0.007 ms med 0.007 ms std 0.006 H write close cnt 11572 min 0.013 ms max 2.195 ms avg 0.020 ms med 0.018 ms std 0.024 I mkdir cnt 1070 min 0.019 ms max 638.208 ms avg 25.813 ms med 0.028 ms std 93.042 J write rate 442.952 MB/s (data) 209.342 MB/s (open + 1st byte + data + close) A read dir cnt 7680 min 0.001 ms max 26.461 ms avg 0.113 ms med 0.004 ms std 0.987 B lstat file cnt 7166 min 0.007 ms max 22.064 ms avg 0.104 ms med 0.023 ms std 0.908 C open file cnt 5619 min 0.014 ms max 0.325 ms avg 0.021 ms med 0.017 ms std 0.013 D rd 1st byte cnt 5619 min 0.178 ms max 316.214 ms avg 3.241 ms med 0.287 ms std 18.914 E read rate 13.995 MB/s (data) 4.739 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 33013 min 0.001 ms max 58.116 ms avg 0.054 ms med 0.004 ms std 0.579 B lstat file cnt 30792 min 0.007 ms max 16.707 ms avg 0.051 ms med 0.023 ms std 0.394 C open file cnt 24130 min 0.014 ms max 0.367 ms avg 0.021 ms med 0.020 ms std 0.011 D rd 1st byte cnt 24130 min 0.176 ms max 82.886 ms avg 0.567 ms med 0.269 ms std 1.819 E read rate 60.101 MB/s (data) 23.406 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14480 min 0.001 ms max 90.560 ms avg 0.120 ms med 0.004 ms std 1.222 B lstat file cnt 13542 min 0.007 ms max 17.994 ms avg 0.096 ms med 0.022 ms std 0.804 C open file cnt 10725 min 0.014 ms max 0.355 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 10725 min 0.174 ms max 93.931 ms avg 1.400 ms med 0.293 ms std 3.280 E read rate 25.837 MB/s (data) 10.000 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 7236 min 0.036 ms max 1105.190 ms avg 0.438 ms med 0.042 ms std 17.751 G wr 1st byte cnt 7236 min 0.006 ms max 0.190 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 7236 min 0.013 ms max 1.150 ms avg 0.020 ms med 0.018 ms std 0.019 I mkdir cnt 670 min 0.019 ms max 4653.852 ms avg 37.494 ms med 0.027 ms std 302.324 J write rate 381.108 MB/s (data) 66.840 MB/s (open + 1st byte + data + close) A read dir cnt 615 min 0.001 ms max 544.403 ms avg 1.034 ms med 0.003 ms std 21.970 B lstat file cnt 576 min 0.007 ms max 71.544 ms avg 0.202 ms med 0.017 ms std 3.028 C open file cnt 457 min 0.014 ms max 0.163 ms avg 0.019 ms med 0.017 ms std 0.013 D rd 1st byte cnt 457 min 0.178 ms max 2578.029 ms avg 37.586 ms med 0.294 ms std 215.327 E read rate 1.606 MB/s (data) 0.523 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 33887 min 0.001 ms max 17.604 ms avg 0.052 ms med 0.004 ms std 0.483 B lstat file cnt 31614 min 0.007 ms max 10.619 ms avg 0.050 ms med 0.022 ms std 0.383 C open file cnt 24785 min 0.014 ms max 0.177 ms avg 0.021 ms med 0.021 ms std 0.011 D rd 1st byte cnt 24785 min 0.173 ms max 83.240 ms avg 0.549 ms med 0.267 ms std 1.843 E read rate 61.873 MB/s (data) 24.108 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15137 min 0.001 ms max 82.487 ms avg 0.115 ms med 0.003 ms std 1.167 B lstat file cnt 14163 min 0.007 ms max 50.996 ms avg 0.103 ms med 0.022 ms std 0.987 C open file cnt 11240 min 0.014 ms max 0.326 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 11240 min 0.172 ms max 120.521 ms avg 1.293 ms med 0.289 ms std 3.373 E read rate 26.246 MB/s (data) 10.503 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 10550 min 0.036 ms max 1899.554 ms avg 0.424 ms med 0.042 ms std 21.168 G wr 1st byte cnt 10550 min 0.006 ms max 41.117 ms avg 0.011 ms med 0.007 ms std 0.400 H write close cnt 10550 min 0.012 ms max 1.183 ms avg 0.020 ms med 0.018 ms std 0.019 I mkdir cnt 990 min 0.018 ms max 3528.339 ms avg 24.633 ms med 0.026 ms std 232.286 J write rate 409.948 MB/s (data) 69.554 MB/s (open + 1st byte + data + close) A read dir cnt 1514 min 0.001 ms max 24.945 ms avg 0.159 ms med 0.003 ms std 1.276 B lstat file cnt 1423 min 0.007 ms max 10.887 ms avg 0.070 ms med 0.018 ms std 0.599 C open file cnt 1148 min 0.014 ms max 0.271 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 1148 min 0.175 ms max 2733.171 ms avg 15.926 ms med 0.297 ms std 130.599 E read rate 2.155 MB/s (data) 0.894 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 34467 min 0.001 ms max 49.214 ms avg 0.055 ms med 0.004 ms std 0.602 B lstat file cnt 32153 min 0.007 ms max 53.866 ms avg 0.053 ms med 0.023 ms std 0.508 C open file cnt 25211 min 0.014 ms max 0.193 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 25211 min 0.173 ms max 94.889 ms avg 0.532 ms med 0.265 ms std 1.509 E read rate 63.806 MB/s (data) 24.720 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15189 min 0.001 ms max 25.503 ms avg 0.113 ms med 0.003 ms std 1.000 B lstat file cnt 14205 min 0.007 ms max 24.900 ms avg 0.094 ms med 0.022 ms std 0.829 C open file cnt 11256 min 0.014 ms max 0.339 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 11256 min 0.173 ms max 114.146 ms avg 1.332 ms med 0.295 ms std 3.345 E read rate 27.598 MB/s (data) 10.581 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 10277 min 0.036 ms max 1255.350 ms avg 0.384 ms med 0.042 ms std 14.872 G wr 1st byte cnt 10277 min 0.006 ms max 29.831 ms avg 0.011 ms med 0.007 ms std 0.299 H write close cnt 10277 min 0.013 ms max 4.470 ms avg 0.022 ms med 0.019 ms std 0.062 I mkdir cnt 965 min 0.021 ms max 5485.645 ms avg 26.201 ms med 0.028 ms std 284.187 J write rate 363.931 MB/s (data) 72.918 MB/s (open + 1st byte + data + close) A read dir cnt 1367 min 0.001 ms max 2823.202 ms avg 3.081 ms med 0.003 ms std 78.743 B lstat file cnt 1289 min 0.007 ms max 3288.305 ms avg 4.693 ms med 0.017 ms std 101.642 C open file cnt 1061 min 0.014 ms max 0.340 ms avg 0.020 ms med 0.017 ms std 0.017 D rd 1st byte cnt 1061 min 0.177 ms max 3074.821 ms avg 15.924 ms med 0.288 ms std 149.493 E read rate 8.553 MB/s (data) 1.067 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 32792 min 0.001 ms max 91.430 ms avg 0.058 ms med 0.004 ms std 0.842 B lstat file cnt 30589 min 0.007 ms max 70.375 ms avg 0.054 ms med 0.023 ms std 0.592 C open file cnt 23985 min 0.014 ms max 0.218 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 23985 min 0.174 ms max 96.703 ms avg 0.555 ms med 0.267 ms std 1.765 E read rate 58.871 MB/s (data) 23.354 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 14232 min 0.001 ms max 27.425 ms avg 0.112 ms med 0.003 ms std 0.972 B lstat file cnt 13309 min 0.007 ms max 27.599 ms avg 0.097 ms med 0.022 ms std 0.818 C open file cnt 10543 min 0.014 ms max 0.505 ms avg 0.022 ms med 0.017 ms std 0.020 D rd 1st byte cnt 10543 min 0.175 ms max 96.442 ms avg 1.426 ms med 0.296 ms std 3.562 E read rate 25.181 MB/s (data) 9.868 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 12943 min 0.036 ms max 1094.390 ms avg 0.282 ms med 0.042 ms std 12.387 G wr 1st byte cnt 12943 min 0.006 ms max 0.606 ms avg 0.007 ms med 0.007 ms std 0.010 H write close cnt 12943 min 0.013 ms max 0.942 ms avg 0.020 ms med 0.018 ms std 0.016 I mkdir cnt 1217 min 0.017 ms max 5361.519 ms avg 19.651 ms med 0.026 ms std 237.454 J write rate 391.145 MB/s (data) 93.071 MB/s (open + 1st byte + data + close) A read dir cnt 1092 min 0.001 ms max 18.028 ms avg 0.162 ms med 0.003 ms std 1.282 B lstat file cnt 1024 min 0.007 ms max 199.578 ms avg 0.314 ms med 0.018 ms std 6.306 C open file cnt 819 min 0.015 ms max 1.309 ms avg 0.023 ms med 0.017 ms std 0.053 D rd 1st byte cnt 819 min 0.178 ms max 3686.618 ms avg 18.786 ms med 0.307 ms std 157.549 E read rate 1.616 MB/s (data) 0.762 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 25111 min 0.001 ms max 99.048 ms avg 0.073 ms med 0.004 ms std 0.972 B lstat file cnt 23394 min 0.007 ms max 110.371 ms avg 0.068 ms med 0.023 ms std 0.941 C open file cnt 18239 min 0.014 ms max 0.453 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 18239 min 0.178 ms max 259.408 ms avg 0.798 ms med 0.268 ms std 3.641 E read rate 47.209 MB/s (data) 17.573 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 8290 min 0.001 ms max 28.647 ms avg 0.106 ms med 0.004 ms std 0.956 B lstat file cnt 7759 min 0.007 ms max 63.726 ms avg 0.107 ms med 0.023 ms std 1.161 C open file cnt 6166 min 0.014 ms max 0.382 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 6166 min 0.178 ms max 315.161 ms avg 2.787 ms med 0.289 ms std 15.601 E read rate 15.708 MB/s (data) 5.722 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 8822 min 0.036 ms max 418.613 ms avg 0.142 ms med 0.041 ms std 5.083 G wr 1st byte cnt 8822 min 0.006 ms max 0.360 ms avg 0.007 ms med 0.007 ms std 0.009 H write close cnt 8822 min 0.013 ms max 4.780 ms avg 0.020 ms med 0.018 ms std 0.055 I mkdir cnt 806 min 0.020 ms max 719.475 ms avg 28.053 ms med 0.030 ms std 100.667 J write rate 9.837 MB/s (data) 9.398 MB/s (open + 1st byte + data + close) A read dir cnt 11508 min 0.001 ms max 93.643 ms avg 0.148 ms med 0.004 ms std 1.473 B lstat file cnt 10750 min 0.007 ms max 349.850 ms avg 0.171 ms med 0.023 ms std 4.083 C open file cnt 8482 min 0.014 ms max 0.529 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 8482 min 0.178 ms max 435.491 ms avg 3.809 ms med 0.295 ms std 22.887 E read rate 10.491 MB/s (data) 3.855 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31439 min 0.001 ms max 97.017 ms avg 0.059 ms med 0.004 ms std 0.782 B lstat file cnt 29318 min 0.007 ms max 25.313 ms avg 0.055 ms med 0.022 ms std 0.475 C open file cnt 22956 min 0.014 ms max 3.585 ms avg 0.021 ms med 0.018 ms std 0.026 D rd 1st byte cnt 22956 min 0.178 ms max 104.566 ms avg 0.631 ms med 0.268 ms std 2.853 E read rate 61.999 MB/s (data) 22.212 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 7536 min 0.001 ms max 53.013 ms avg 0.105 ms med 0.004 ms std 1.055 B lstat file cnt 7048 min 0.007 ms max 16.627 ms avg 0.084 ms med 0.023 ms std 0.695 C open file cnt 5579 min 0.014 ms max 0.260 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 5579 min 0.178 ms max 277.148 ms avg 3.024 ms med 0.280 ms std 18.996 E read rate 13.207 MB/s (data) 5.118 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 9599 min 0.036 ms max 200.066 ms avg 0.134 ms med 0.041 ms std 3.470 G wr 1st byte cnt 9599 min 0.006 ms max 0.434 ms avg 0.007 ms med 0.007 ms std 0.008 H write close cnt 9599 min 0.013 ms max 5.910 ms avg 0.019 ms med 0.018 ms std 0.064 I mkdir cnt 872 min 0.020 ms max 4146.886 ms avg 29.802 ms med 0.028 ms std 173.697 J write rate 32.139 MB/s (data) 28.145 MB/s (open + 1st byte + data + close) A read dir cnt 7634 min 0.001 ms max 77.461 ms avg 0.136 ms med 0.004 ms std 1.496 B lstat file cnt 7144 min 0.007 ms max 375.632 ms avg 0.270 ms med 0.023 ms std 6.798 C open file cnt 5677 min 0.014 ms max 0.243 ms avg 0.021 ms med 0.018 ms std 0.013 D rd 1st byte cnt 5677 min 0.177 ms max 596.168 ms avg 4.117 ms med 0.295 ms std 23.440 E read rate 11.681 MB/s (data) 3.918 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31684 min 0.001 ms max 62.069 ms avg 0.059 ms med 0.004 ms std 0.731 B lstat file cnt 29552 min 0.007 ms max 108.253 ms avg 0.061 ms med 0.023 ms std 1.027 C open file cnt 23152 min 0.014 ms max 0.326 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 23152 min 0.177 ms max 91.850 ms avg 0.613 ms med 0.267 ms std 2.875 E read rate 62.017 MB/s (data) 22.582 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 10276 min 0.001 ms max 64.094 ms avg 0.092 ms med 0.004 ms std 1.014 B lstat file cnt 9606 min 0.007 ms max 56.857 ms avg 0.102 ms med 0.023 ms std 1.085 C open file cnt 7601 min 0.014 ms max 0.295 ms avg 0.021 ms med 0.017 ms std 0.014 D rd 1st byte cnt 7601 min 0.177 ms max 227.394 ms avg 2.244 ms med 0.288 ms std 11.157 E read rate 19.579 MB/s (data) 7.021 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 10937 min 0.036 ms max 285.398 ms avg 0.134 ms med 0.042 ms std 3.933 G wr 1st byte cnt 10937 min 0.006 ms max 0.329 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 10937 min 0.012 ms max 63.909 ms avg 0.026 ms med 0.018 ms std 0.614 I mkdir cnt 999 min 0.020 ms max 13934.114 ms avg 40.125 ms med 0.029 ms std 451.103 J write rate 442.768 MB/s (data) 151.061 MB/s (open + 1st byte + data + close) A read dir cnt 8411 min 0.001 ms max 21.321 ms avg 0.139 ms med 0.004 ms std 1.057 B lstat file cnt 7852 min 0.007 ms max 399.139 ms avg 0.155 ms med 0.023 ms std 4.595 C open file cnt 6171 min 0.014 ms max 0.319 ms avg 0.021 ms med 0.017 ms std 0.012 D rd 1st byte cnt 6171 min 0.176 ms max 518.715 ms avg 4.411 ms med 0.294 ms std 24.568 E read rate 11.716 MB/s (data) 3.693 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 32157 min 0.001 ms max 94.186 ms avg 0.059 ms med 0.004 ms std 0.950 B lstat file cnt 29998 min 0.007 ms max 96.794 ms avg 0.058 ms med 0.023 ms std 0.951 C open file cnt 23523 min 0.014 ms max 0.183 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 23523 min 0.177 ms max 97.955 ms avg 0.588 ms med 0.265 ms std 2.381 E read rate 60.726 MB/s (data) 22.936 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 10459 min 0.001 ms max 73.369 ms avg 0.119 ms med 0.004 ms std 1.367 B lstat file cnt 9784 min 0.007 ms max 100.203 ms avg 0.139 ms med 0.023 ms std 2.015 C open file cnt 7751 min 0.014 ms max 0.249 ms avg 0.021 ms med 0.017 ms std 0.013 D rd 1st byte cnt 7751 min 0.177 ms max 169.565 ms avg 2.074 ms med 0.296 ms std 9.005 E read rate 19.502 MB/s (data) 7.285 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 7642 min 0.036 ms max 100.217 ms avg 0.132 ms med 0.041 ms std 2.626 G wr 1st byte cnt 7642 min 0.006 ms max 0.276 ms avg 0.007 ms med 0.007 ms std 0.008 H write close cnt 7642 min 0.013 ms max 2.990 ms avg 0.019 ms med 0.017 ms std 0.037 I mkdir cnt 704 min 0.018 ms max 842.140 ms avg 25.249 ms med 0.026 ms std 93.971 J write rate 20.696 MB/s (data) 18.967 MB/s (open + 1st byte + data + close) A read dir cnt 6766 min 0.001 ms max 35.040 ms avg 0.126 ms med 0.004 ms std 1.144 B lstat file cnt 6312 min 0.007 ms max 47.298 ms avg 0.107 ms med 0.023 ms std 0.979 C open file cnt 4949 min 0.014 ms max 24.060 ms avg 0.026 ms med 0.017 ms std 0.342 D rd 1st byte cnt 4949 min 0.177 ms max 406.167 ms avg 3.960 ms med 0.293 ms std 22.201 E read rate 11.087 MB/s (data) 3.874 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31303 min 0.001 ms max 63.465 ms avg 0.055 ms med 0.004 ms std 0.634 B lstat file cnt 29191 min 0.007 ms max 90.452 ms avg 0.057 ms med 0.023 ms std 0.816 C open file cnt 22854 min 0.014 ms max 0.185 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 22854 min 0.175 ms max 98.549 ms avg 0.589 ms med 0.268 ms std 2.548 E read rate 55.335 MB/s (data) 22.162 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 13950 min 0.001 ms max 64.935 ms avg 0.118 ms med 0.003 ms std 1.115 B lstat file cnt 13049 min 0.007 ms max 83.659 ms avg 0.101 ms med 0.022 ms std 1.065 C open file cnt 10349 min 0.014 ms max 0.475 ms avg 0.021 ms med 0.017 ms std 0.018 D rd 1st byte cnt 10349 min 0.174 ms max 123.936 ms avg 1.481 ms med 0.298 ms std 4.391 E read rate 25.491 MB/s (data) 9.680 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 856 min 0.036 ms max 963.791 ms avg 1.174 ms med 0.042 ms std 32.921 G wr 1st byte cnt 856 min 0.006 ms max 0.018 ms avg 0.007 ms med 0.006 ms std 0.001 H write close cnt 856 min 0.012 ms max 0.081 ms avg 0.018 ms med 0.018 ms std 0.004 I mkdir cnt 80 min 0.020 ms max 4028.779 ms avg 381.346 ms med 0.029 ms std 1052.194 J write rate 367.862 MB/s (data) 25.035 MB/s (open + 1st byte + data + close) A read dir cnt 19 min 0.002 ms max 1341.471 ms avg 131.587 ms med 0.005 ms std 384.770 B lstat file cnt 17 min 0.009 ms max 0.101 ms avg 0.031 ms med 0.030 ms std 0.019 C open file cnt 11 min 0.018 ms max 0.030 ms avg 0.023 ms med 0.022 ms std 0.003 D rd 1st byte cnt 11 min 691.655 ms max 2403.483 ms avg 1445.773 ms med 1532.023 ms std 512.153 E read rate 0.045 MB/s (data) 0.020 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 31646 min 0.001 ms max 57.666 ms avg 0.056 ms med 0.004 ms std 0.683 B lstat file cnt 29517 min 0.007 ms max 91.065 ms avg 0.055 ms med 0.023 ms std 0.689 C open file cnt 23125 min 0.014 ms max 0.241 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 23125 min 0.176 ms max 113.775 ms avg 0.599 ms med 0.267 ms std 2.528 E read rate 58.281 MB/s (data) 22.404 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 13767 min 0.001 ms max 90.862 ms avg 0.109 ms med 0.003 ms std 1.163 B lstat file cnt 12877 min 0.007 ms max 102.216 ms avg 0.106 ms med 0.022 ms std 1.228 C open file cnt 10208 min 0.014 ms max 0.467 ms avg 0.021 ms med 0.017 ms std 0.020 D rd 1st byte cnt 10208 min 0.175 ms max 119.421 ms avg 1.441 ms med 0.295 ms std 4.538 E read rate 23.565 MB/s (data) 9.573 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 868 min 0.037 ms max 1028.050 ms avg 2.970 ms med 0.042 ms std 45.712 G wr 1st byte cnt 868 min 0.006 ms max 0.061 ms avg 0.007 ms med 0.007 ms std 0.002 H write close cnt 868 min 0.013 ms max 7.909 ms avg 0.028 ms med 0.018 ms std 0.268 I mkdir cnt 67 min 0.021 ms max 4205.007 ms avg 401.106 ms med 0.032 ms std 1032.918 J write rate 457.974 MB/s (data) 13.804 MB/s (open + 1st byte + data + close) A read dir cnt 34 min 0.002 ms max 1802.079 ms avg 148.892 ms med 0.004 ms std 431.769 B lstat file cnt 30 min 0.008 ms max 0.037 ms avg 0.023 ms med 0.025 ms std 0.008 C open file cnt 16 min 0.018 ms max 0.084 ms avg 0.025 ms med 0.022 ms std 0.015 D rd 1st byte cnt 16 min 446.294 ms max 2811.199 ms avg 963.551 ms med 828.009 ms std 571.931 E read rate 0.093 MB/s (data) 0.021 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30718 min 0.001 ms max 81.412 ms avg 0.055 ms med 0.004 ms std 0.757 B lstat file cnt 28628 min 0.007 ms max 88.438 ms avg 0.063 ms med 0.023 ms std 1.075 C open file cnt 22358 min 0.014 ms max 0.347 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 22358 min 0.175 ms max 96.465 ms avg 0.599 ms med 0.268 ms std 2.590 E read rate 54.313 MB/s (data) 21.799 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 12359 min 0.001 ms max 102.121 ms avg 0.142 ms med 0.004 ms std 1.731 B lstat file cnt 11558 min 0.007 ms max 82.587 ms avg 0.115 ms med 0.022 ms std 1.462 C open file cnt 9158 min 0.014 ms max 0.533 ms avg 0.021 ms med 0.017 ms std 0.018 D rd 1st byte cnt 9158 min 0.174 ms max 120.336 ms avg 1.689 ms med 0.297 ms std 5.278 E read rate 22.961 MB/s (data) 8.583 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1286 min 0.036 ms max 861.336 ms avg 0.731 ms med 0.042 ms std 24.016 G wr 1st byte cnt 1286 min 0.006 ms max 0.014 ms avg 0.007 ms med 0.007 ms std 0.001 H write close cnt 1286 min 0.013 ms max 0.190 ms avg 0.019 ms med 0.018 ms std 0.007 I mkdir cnt 110 min 0.018 ms max 3762.827 ms avg 265.437 ms med 0.026 ms std 820.118 J write rate 460.745 MB/s (data) 47.417 MB/s (open + 1st byte + data + close) A read dir cnt 22 min 0.002 ms max 819.140 ms avg 37.238 ms med 0.005 ms std 170.625 B lstat file cnt 21 min 0.017 ms max 2010.415 ms avg 130.952 ms med 0.028 ms std 448.696 C open file cnt 18 min 0.018 ms max 0.041 ms avg 0.024 ms med 0.024 ms std 0.005 D rd 1st byte cnt 18 min 586.672 ms max 1575.488 ms avg 1017.557 ms med 1037.557 ms std 256.722 E read rate 0.036 MB/s (data) 0.011 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext3 disk=areca RAID6 journal=/dev/journal/scratch_a data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 30734 min 0.001 ms max 59.833 ms avg 0.057 ms med 0.004 ms std 0.649 B lstat file cnt 28645 min 0.007 ms max 59.344 ms avg 0.056 ms med 0.023 ms std 0.652 C open file cnt 22380 min 0.014 ms max 0.304 ms avg 0.022 ms med 0.021 ms std 0.011 D rd 1st byte cnt 22380 min 0.174 ms max 113.723 ms avg 0.619 ms med 0.266 ms std 2.861 E read rate 55.705 MB/s (data) 21.623 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 13317 min 0.001 ms max 99.404 ms avg 0.131 ms med 0.004 ms std 1.634 B lstat file cnt 12459 min 0.007 ms max 58.076 ms avg 0.106 ms med 0.022 ms std 1.036 C open file cnt 9883 min 0.014 ms max 0.313 ms avg 0.021 ms med 0.017 ms std 0.016 D rd 1st byte cnt 9883 min 0.177 ms max 124.065 ms avg 1.534 ms med 0.289 ms std 5.201 E read rate 24.042 MB/s (data) 9.222 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1021 min 0.037 ms max 12.172 ms avg 0.072 ms med 0.041 ms std 0.484 G wr 1st byte cnt 1021 min 0.006 ms max 0.130 ms avg 0.007 ms med 0.007 ms std 0.006 H write close cnt 1021 min 0.013 ms max 0.159 ms avg 0.018 ms med 0.017 ms std 0.007 I mkdir cnt 79 min 0.019 ms max 5018.242 ms avg 351.256 ms med 0.027 ms std 1019.244 J write rate 479.489 MB/s (data) 230.113 MB/s (open + 1st byte + data + close) A read dir cnt 24 min 0.003 ms max 1067.717 ms avg 44.862 ms med 0.006 ms std 213.287 B lstat file cnt 22 min 0.008 ms max 25.369 ms avg 1.194 ms med 0.030 ms std 5.276 C open file cnt 18 min 0.017 ms max 0.034 ms avg 0.023 ms med 0.022 ms std 0.004 D rd 1st byte cnt 18 min 15.423 ms max 3631.425 ms avg 1093.937 ms med 1007.375 ms std 856.780 E read rate 0.045 MB/s (data) 0.013 MB/s (readdir + open + 1st byte + data)