Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 26114 min 0.001 ms max 24.780 ms avg 0.063 ms med 0.004 ms std 0.627 B lstat file cnt 24382 min 0.007 ms max 12.049 ms avg 0.028 ms med 0.025 ms std 0.166 C open file cnt 19188 min 0.014 ms max 0.235 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 19188 min 0.178 ms max 93.969 ms avg 0.797 ms med 0.278 ms std 2.062 E read rate 47.624 MB/s (data) 17.586 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 18706 min 0.001 ms max 28.208 ms avg 0.076 ms med 0.003 ms std 0.706 B lstat file cnt 17455 min 0.007 ms max 17.381 ms avg 0.032 ms med 0.020 ms std 0.315 C open file cnt 13700 min 0.014 ms max 0.504 ms avg 0.020 ms med 0.016 ms std 0.018 D rd 1st byte cnt 13700 min 0.181 ms max 70.644 ms avg 1.124 ms med 0.303 ms std 2.920 E read rate 31.232 MB/s (data) 12.259 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6702 min 0.040 ms max 2284.961 ms avg 2.835 ms med 0.046 ms std 48.061 G wr 1st byte cnt 6702 min 0.006 ms max 0.484 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 6702 min 0.016 ms max 1786.678 ms avg 0.833 ms med 0.023 ms std 30.571 I mkdir cnt 603 min 0.025 ms max 496.176 ms avg 0.858 ms med 0.033 ms std 20.188 J write rate 56.242 MB/s (data) 8.097 MB/s (open + 1st byte + data + close) A read dir cnt 118 min 0.001 ms max 165.946 ms avg 3.114 ms med 0.004 ms std 18.846 B lstat file cnt 112 min 0.008 ms max 0.096 ms avg 0.029 ms med 0.029 ms std 0.011 C open file cnt 92 min 0.016 ms max 0.087 ms avg 0.024 ms med 0.022 ms std 0.013 D rd 1st byte cnt 92 min 0.225 ms max 1878.049 ms avg 251.027 ms med 109.792 ms std 382.825 E read rate 0.578 MB/s (data) 0.123 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 25890 min 0.001 ms max 85.753 ms avg 0.064 ms med 0.004 ms std 0.853 B lstat file cnt 24170 min 0.007 ms max 12.149 ms avg 0.027 ms med 0.024 ms std 0.161 C open file cnt 19011 min 0.014 ms max 0.181 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 19011 min 0.179 ms max 92.911 ms avg 0.801 ms med 0.275 ms std 2.174 E read rate 47.042 MB/s (data) 17.444 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 19010 min 0.001 ms max 23.751 ms avg 0.072 ms med 0.003 ms std 0.682 B lstat file cnt 17746 min 0.007 ms max 25.705 ms avg 0.034 ms med 0.020 ms std 0.383 C open file cnt 13951 min 0.014 ms max 0.358 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 13951 min 0.175 ms max 74.378 ms avg 1.116 ms med 0.294 ms std 2.851 E read rate 32.425 MB/s (data) 12.523 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6213 min 0.040 ms max 2117.082 ms avg 2.360 ms med 0.047 ms std 45.676 G wr 1st byte cnt 6213 min 0.006 ms max 0.836 ms avg 0.007 ms med 0.007 ms std 0.012 H write close cnt 6213 min 0.016 ms max 2983.254 ms avg 0.705 ms med 0.023 ms std 40.897 I mkdir cnt 572 min 0.025 ms max 603.322 ms avg 2.669 ms med 0.032 ms std 34.541 J write rate 26.389 MB/s (data) 8.589 MB/s (open + 1st byte + data + close) A read dir cnt 133 min 0.002 ms max 242.541 ms avg 5.293 ms med 0.004 ms std 30.416 B lstat file cnt 123 min 0.008 ms max 0.099 ms avg 0.026 ms med 0.023 ms std 0.016 C open file cnt 91 min 0.016 ms max 0.096 ms avg 0.022 ms med 0.021 ms std 0.009 D rd 1st byte cnt 91 min 0.208 ms max 2334.766 ms avg 285.967 ms med 28.814 ms std 526.543 E read rate 0.385 MB/s (data) 0.051 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 26447 min 0.001 ms max 15.663 ms avg 0.056 ms med 0.004 ms std 0.519 B lstat file cnt 24691 min 0.007 ms max 12.184 ms avg 0.027 ms med 0.024 ms std 0.162 C open file cnt 19422 min 0.014 ms max 0.186 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 19422 min 0.177 ms max 99.859 ms avg 0.793 ms med 0.277 ms std 2.409 E read rate 48.275 MB/s (data) 17.834 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 18614 min 0.001 ms max 15.927 ms avg 0.070 ms med 0.003 ms std 0.645 B lstat file cnt 17379 min 0.007 ms max 18.299 ms avg 0.034 ms med 0.021 ms std 0.376 C open file cnt 13676 min 0.014 ms max 0.342 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 13676 min 0.178 ms max 65.212 ms avg 1.138 ms med 0.293 ms std 2.893 E read rate 31.584 MB/s (data) 12.332 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6112 min 0.040 ms max 2000.229 ms avg 2.795 ms med 0.046 ms std 56.822 G wr 1st byte cnt 6112 min 0.006 ms max 0.124 ms avg 0.007 ms med 0.007 ms std 0.003 H write close cnt 6112 min 0.016 ms max 869.307 ms avg 0.340 ms med 0.022 ms std 15.547 I mkdir cnt 569 min 0.024 ms max 510.461 ms avg 1.796 ms med 0.032 ms std 29.071 J write rate 23.904 MB/s (data) 8.182 MB/s (open + 1st byte + data + close) A read dir cnt 92 min 0.002 ms max 1233.720 ms avg 14.396 ms med 0.004 ms std 127.962 B lstat file cnt 87 min 0.008 ms max 0.099 ms avg 0.026 ms med 0.025 ms std 0.011 C open file cnt 71 min 0.016 ms max 0.089 ms avg 0.022 ms med 0.021 ms std 0.009 D rd 1st byte cnt 71 min 0.199 ms max 2253.889 ms avg 323.623 ms med 87.625 ms std 509.446 E read rate 0.316 MB/s (data) 0.040 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 24981 min 0.001 ms max 100.092 ms avg 0.063 ms med 0.004 ms std 0.982 B lstat file cnt 23326 min 0.007 ms max 18.094 ms avg 0.027 ms med 0.024 ms std 0.152 C open file cnt 18360 min 0.014 ms max 0.231 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 18360 min 0.176 ms max 117.183 ms avg 0.816 ms med 0.276 ms std 2.701 E read rate 43.606 MB/s (data) 16.830 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 17861 min 0.001 ms max 58.612 ms avg 0.080 ms med 0.004 ms std 0.865 B lstat file cnt 16663 min 0.007 ms max 28.341 ms avg 0.036 ms med 0.021 ms std 0.452 C open file cnt 13066 min 0.014 ms max 0.362 ms avg 0.020 ms med 0.016 ms std 0.015 D rd 1st byte cnt 13066 min 0.178 ms max 93.577 ms avg 1.206 ms med 0.293 ms std 3.607 E read rate 30.828 MB/s (data) 11.721 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6481 min 0.040 ms max 1334.804 ms avg 1.767 ms med 0.046 ms std 32.515 G wr 1st byte cnt 6481 min 0.006 ms max 0.176 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 6481 min 0.016 ms max 474.921 ms avg 0.120 ms med 0.022 ms std 6.008 I mkdir cnt 602 min 0.024 ms max 311.850 ms avg 0.815 ms med 0.032 ms std 14.231 J write rate 16.972 MB/s (data) 9.261 MB/s (open + 1st byte + data + close) A read dir cnt 203 min 0.002 ms max 266.619 ms avg 2.550 ms med 0.004 ms std 21.799 B lstat file cnt 191 min 0.008 ms max 0.137 ms avg 0.025 ms med 0.025 ms std 0.013 C open file cnt 158 min 0.015 ms max 0.032 ms avg 0.019 ms med 0.018 ms std 0.004 D rd 1st byte cnt 158 min 0.192 ms max 2336.294 ms avg 151.582 ms med 0.744 ms std 403.710 E read rate 1.013 MB/s (data) 0.161 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 25588 min 0.001 ms max 70.451 ms avg 0.062 ms med 0.004 ms std 0.808 B lstat file cnt 23887 min 0.007 ms max 19.867 ms avg 0.028 ms med 0.024 ms std 0.236 C open file cnt 18783 min 0.014 ms max 0.227 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 18783 min 0.176 ms max 118.184 ms avg 0.817 ms med 0.273 ms std 2.902 E read rate 46.613 MB/s (data) 17.217 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 19651 min 0.001 ms max 18.644 ms avg 0.075 ms med 0.003 ms std 0.669 B lstat file cnt 18340 min 0.007 ms max 19.926 ms avg 0.033 ms med 0.019 ms std 0.329 C open file cnt 14407 min 0.014 ms max 0.420 ms avg 0.021 ms med 0.016 ms std 0.020 D rd 1st byte cnt 14407 min 0.177 ms max 41.808 ms avg 1.054 ms med 0.295 ms std 2.551 E read rate 32.903 MB/s (data) 13.008 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6900 min 0.040 ms max 2488.570 ms avg 1.612 ms med 0.046 ms std 41.531 G wr 1st byte cnt 6900 min 0.006 ms max 0.188 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 6900 min 0.016 ms max 2773.031 ms avg 1.123 ms med 0.023 ms std 46.097 I mkdir cnt 638 min 0.025 ms max 313.693 ms avg 0.689 ms med 0.032 ms std 12.742 J write rate 22.728 MB/s (data) 8.643 MB/s (open + 1st byte + data + close) A read dir cnt 167 min 0.001 ms max 679.555 ms avg 6.871 ms med 0.004 ms std 59.975 B lstat file cnt 154 min 0.008 ms max 0.471 ms avg 0.030 ms med 0.024 ms std 0.041 C open file cnt 118 min 0.016 ms max 0.227 ms avg 0.024 ms med 0.021 ms std 0.022 D rd 1st byte cnt 118 min 0.204 ms max 2537.635 ms avg 200.090 ms med 12.779 ms std 422.413 E read rate 0.662 MB/s (data) 0.145 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 24409 min 0.001 ms max 125.358 ms avg 0.062 ms med 0.004 ms std 0.961 B lstat file cnt 22787 min 0.007 ms max 18.443 ms avg 0.028 ms med 0.025 ms std 0.212 C open file cnt 17919 min 0.014 ms max 0.280 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 17919 min 0.177 ms max 125.220 ms avg 0.874 ms med 0.275 ms std 3.334 E read rate 45.155 MB/s (data) 16.426 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 18733 min 0.001 ms max 24.013 ms avg 0.076 ms med 0.003 ms std 0.732 B lstat file cnt 17481 min 0.007 ms max 43.570 ms avg 0.036 ms med 0.020 ms std 0.527 C open file cnt 13726 min 0.014 ms max 0.485 ms avg 0.021 ms med 0.016 ms std 0.019 D rd 1st byte cnt 13726 min 0.177 ms max 97.443 ms avg 1.096 ms med 0.300 ms std 3.132 E read rate 30.638 MB/s (data) 12.346 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6375 min 0.040 ms max 3260.224 ms avg 2.031 ms med 0.046 ms std 56.736 G wr 1st byte cnt 6375 min 0.006 ms max 0.114 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 6375 min 0.016 ms max 2982.294 ms avg 0.574 ms med 0.023 ms std 37.495 I mkdir cnt 587 min 0.025 ms max 429.922 ms avg 1.698 ms med 0.033 ms std 22.781 J write rate 17.197 MB/s (data) 7.981 MB/s (open + 1st byte + data + close) A read dir cnt 170 min 0.001 ms max 652.944 ms avg 7.921 ms med 0.004 ms std 53.511 B lstat file cnt 156 min 0.008 ms max 0.348 ms avg 0.028 ms med 0.024 ms std 0.029 C open file cnt 115 min 0.015 ms max 0.210 ms avg 0.023 ms med 0.021 ms std 0.021 D rd 1st byte cnt 115 min 0.191 ms max 2598.094 ms avg 217.963 ms med 19.665 ms std 437.729 E read rate 0.517 MB/s (data) 0.095 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 24702 min 0.001 ms max 72.508 ms avg 0.061 ms med 0.004 ms std 0.723 B lstat file cnt 23061 min 0.007 ms max 20.195 ms avg 0.029 ms med 0.025 ms std 0.224 C open file cnt 18139 min 0.014 ms max 0.212 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 18139 min 0.175 ms max 105.600 ms avg 0.837 ms med 0.277 ms std 2.903 E read rate 43.685 MB/s (data) 16.623 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 17887 min 0.001 ms max 94.635 ms avg 0.087 ms med 0.003 ms std 1.098 B lstat file cnt 16688 min 0.007 ms max 86.327 ms avg 0.038 ms med 0.021 ms std 0.760 C open file cnt 13088 min 0.014 ms max 0.546 ms avg 0.021 ms med 0.016 ms std 0.018 D rd 1st byte cnt 13088 min 0.175 ms max 111.436 ms avg 1.158 ms med 0.296 ms std 3.497 E read rate 29.653 MB/s (data) 11.728 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6121 min 0.040 ms max 2098.957 ms avg 2.178 ms med 0.046 ms std 42.733 G wr 1st byte cnt 6121 min 0.006 ms max 0.216 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 6121 min 0.016 ms max 41.059 ms avg 0.035 ms med 0.023 ms std 0.530 I mkdir cnt 568 min 0.025 ms max 1194.535 ms avg 4.947 ms med 0.034 ms std 66.467 J write rate 17.958 MB/s (data) 8.928 MB/s (open + 1st byte + data + close) A read dir cnt 99 min 0.002 ms max 735.004 ms avg 21.489 ms med 0.004 ms std 106.131 B lstat file cnt 92 min 0.008 ms max 0.114 ms avg 0.029 ms med 0.027 ms std 0.017 C open file cnt 71 min 0.016 ms max 0.713 ms avg 0.033 ms med 0.021 ms std 0.083 D rd 1st byte cnt 71 min 0.243 ms max 2086.293 ms avg 241.148 ms med 145.403 ms std 340.942 E read rate 0.240 MB/s (data) 0.086 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23835 min 0.001 ms max 16.628 ms avg 0.054 ms med 0.004 ms std 0.504 B lstat file cnt 22245 min 0.007 ms max 15.220 ms avg 0.027 ms med 0.024 ms std 0.160 C open file cnt 17476 min 0.014 ms max 0.240 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 17476 min 0.176 ms max 96.750 ms avg 0.864 ms med 0.278 ms std 3.151 E read rate 40.564 MB/s (data) 16.007 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 18516 min 0.001 ms max 19.382 ms avg 0.078 ms med 0.003 ms std 0.737 B lstat file cnt 17280 min 0.007 ms max 68.238 ms avg 0.036 ms med 0.021 ms std 0.629 C open file cnt 13567 min 0.014 ms max 0.479 ms avg 0.020 ms med 0.016 ms std 0.018 D rd 1st byte cnt 13567 min 0.177 ms max 124.797 ms avg 1.134 ms med 0.295 ms std 3.561 E read rate 31.097 MB/s (data) 12.158 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6360 min 0.040 ms max 2273.616 ms avg 2.272 ms med 0.046 ms std 48.224 G wr 1st byte cnt 6360 min 0.006 ms max 0.128 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 6360 min 0.016 ms max 2221.346 ms avg 0.511 ms med 0.022 ms std 28.809 I mkdir cnt 589 min 0.025 ms max 1022.873 ms avg 3.533 ms med 0.032 ms std 49.036 J write rate 27.983 MB/s (data) 9.336 MB/s (open + 1st byte + data + close) A read dir cnt 182 min 0.001 ms max 433.061 ms avg 4.725 ms med 0.004 ms std 40.219 B lstat file cnt 166 min 0.008 ms max 0.101 ms avg 0.024 ms med 0.022 ms std 0.012 C open file cnt 120 min 0.015 ms max 0.056 ms avg 0.021 ms med 0.019 ms std 0.005 D rd 1st byte cnt 120 min 0.206 ms max 1967.844 ms avg 198.389 ms med 27.275 ms std 329.618 E read rate 0.589 MB/s (data) 0.100 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23232 min 0.001 ms max 76.210 ms avg 0.062 ms med 0.004 ms std 0.765 B lstat file cnt 21683 min 0.007 ms max 31.631 ms avg 0.029 ms med 0.024 ms std 0.258 C open file cnt 17038 min 0.014 ms max 0.218 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 17038 min 0.176 ms max 101.646 ms avg 0.898 ms med 0.276 ms std 3.534 E read rate 40.491 MB/s (data) 15.554 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16091 min 0.001 ms max 86.404 ms avg 0.107 ms med 0.003 ms std 1.534 B lstat file cnt 15012 min 0.007 ms max 83.366 ms avg 0.039 ms med 0.022 ms std 0.785 C open file cnt 11774 min 0.014 ms max 0.365 ms avg 0.021 ms med 0.016 ms std 0.016 D rd 1st byte cnt 11774 min 0.176 ms max 118.623 ms avg 1.282 ms med 0.296 ms std 4.499 E read rate 26.080 MB/s (data) 10.353 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5511 min 0.039 ms max 758.948 ms avg 0.668 ms med 0.046 ms std 14.897 G wr 1st byte cnt 5511 min 0.006 ms max 0.224 ms avg 0.007 ms med 0.007 ms std 0.006 H write close cnt 5511 min 0.011 ms max 1396.184 ms avg 1.614 ms med 0.017 ms std 39.068 I mkdir cnt 497 min 0.026 ms max 975.691 ms avg 2.244 ms med 0.032 ms std 44.054 J write rate 11.023 MB/s (data) 6.266 MB/s (open + 1st byte + data + close) A read dir cnt 6223 min 0.001 ms max 166.455 ms avg 0.151 ms med 0.004 ms std 2.423 B lstat file cnt 5811 min 0.007 ms max 288.810 ms avg 0.093 ms med 0.022 ms std 3.842 C open file cnt 4575 min 0.014 ms max 0.658 ms avg 0.022 ms med 0.017 ms std 0.026 D rd 1st byte cnt 4575 min 0.182 ms max 1539.857 ms avg 3.639 ms med 0.338 ms std 26.820 E read rate 10.055 MB/s (data) 4.071 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23543 min 0.001 ms max 89.114 ms avg 0.065 ms med 0.004 ms std 0.984 B lstat file cnt 21970 min 0.007 ms max 12.794 ms avg 0.027 ms med 0.024 ms std 0.148 C open file cnt 17252 min 0.014 ms max 0.234 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 17252 min 0.175 ms max 113.443 ms avg 0.906 ms med 0.281 ms std 3.794 E read rate 42.943 MB/s (data) 15.779 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15544 min 0.001 ms max 107.363 ms avg 0.118 ms med 0.003 ms std 2.013 B lstat file cnt 14498 min 0.007 ms max 27.377 ms avg 0.035 ms med 0.021 ms std 0.412 C open file cnt 11360 min 0.014 ms max 0.400 ms avg 0.021 ms med 0.016 ms std 0.018 D rd 1st byte cnt 11360 min 0.176 ms max 125.327 ms avg 1.355 ms med 0.302 ms std 5.549 E read rate 25.881 MB/s (data) 9.957 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4548 min 0.039 ms max 920.686 ms avg 0.849 ms med 0.045 ms std 18.678 G wr 1st byte cnt 4548 min 0.006 ms max 0.470 ms avg 0.008 ms med 0.007 ms std 0.013 H write close cnt 4548 min 0.011 ms max 950.578 ms avg 1.178 ms med 0.016 ms std 28.466 I mkdir cnt 416 min 0.025 ms max 1545.363 ms avg 3.780 ms med 0.033 ms std 75.675 J write rate 7.736 MB/s (data) 5.177 MB/s (open + 1st byte + data + close) A read dir cnt 6867 min 0.001 ms max 109.748 ms avg 0.194 ms med 0.004 ms std 2.657 B lstat file cnt 6412 min 0.007 ms max 20.531 ms avg 0.042 ms med 0.023 ms std 0.478 C open file cnt 5048 min 0.014 ms max 1.435 ms avg 0.022 ms med 0.017 ms std 0.040 D rd 1st byte cnt 5048 min 0.179 ms max 1781.948 ms avg 3.544 ms med 0.330 ms std 33.079 E read rate 12.864 MB/s (data) 4.449 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 26311 min 0.001 ms max 26.496 ms avg 0.058 ms med 0.004 ms std 0.567 B lstat file cnt 24567 min 0.007 ms max 12.441 ms avg 0.027 ms med 0.024 ms std 0.164 C open file cnt 19333 min 0.014 ms max 0.161 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 19333 min 0.177 ms max 94.760 ms avg 0.798 ms med 0.274 ms std 2.439 E read rate 48.322 MB/s (data) 17.756 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 17685 min 0.001 ms max 84.956 ms avg 0.084 ms med 0.003 ms std 1.032 B lstat file cnt 16495 min 0.007 ms max 19.487 ms avg 0.035 ms med 0.022 ms std 0.393 C open file cnt 12926 min 0.014 ms max 0.472 ms avg 0.020 ms med 0.016 ms std 0.015 D rd 1st byte cnt 12926 min 0.175 ms max 102.660 ms avg 1.208 ms med 0.296 ms std 3.653 E read rate 30.218 MB/s (data) 11.605 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4775 min 0.039 ms max 4738.857 ms avg 2.255 ms med 0.046 ms std 71.780 G wr 1st byte cnt 4775 min 0.006 ms max 0.267 ms avg 0.007 ms med 0.007 ms std 0.006 H write close cnt 4775 min 0.011 ms max 1113.221 ms avg 0.274 ms med 0.017 ms std 16.172 I mkdir cnt 442 min 0.025 ms max 1077.728 ms avg 4.072 ms med 0.033 ms std 56.356 J write rate 8.341 MB/s (data) 5.036 MB/s (open + 1st byte + data + close) A read dir cnt 4793 min 0.001 ms max 242.823 ms avg 0.257 ms med 0.004 ms std 5.050 B lstat file cnt 4469 min 0.007 ms max 84.981 ms avg 0.052 ms med 0.023 ms std 1.313 C open file cnt 3497 min 0.015 ms max 0.298 ms avg 0.021 ms med 0.017 ms std 0.018 D rd 1st byte cnt 3497 min 0.178 ms max 4825.524 ms avg 5.867 ms med 0.325 ms std 96.586 E read rate 7.644 MB/s (data) 2.709 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 24071 min 0.001 ms max 86.520 ms avg 0.058 ms med 0.004 ms std 0.760 B lstat file cnt 22470 min 0.007 ms max 11.655 ms avg 0.027 ms med 0.024 ms std 0.158 C open file cnt 17666 min 0.014 ms max 0.228 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 17666 min 0.179 ms max 116.932 ms avg 0.885 ms med 0.279 ms std 3.595 E read rate 43.707 MB/s (data) 16.196 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16757 min 0.001 ms max 49.047 ms avg 0.076 ms med 0.003 ms std 0.788 B lstat file cnt 15625 min 0.007 ms max 18.054 ms avg 0.031 ms med 0.022 ms std 0.282 C open file cnt 12226 min 0.014 ms max 0.426 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 12226 min 0.179 ms max 116.728 ms avg 1.286 ms med 0.296 ms std 4.648 E read rate 27.352 MB/s (data) 10.722 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4983 min 0.040 ms max 773.714 ms avg 1.875 ms med 0.046 ms std 27.873 G wr 1st byte cnt 4983 min 0.006 ms max 0.187 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 4983 min 0.011 ms max 2768.596 ms avg 1.004 ms med 0.019 ms std 43.131 I mkdir cnt 464 min 0.025 ms max 5780.388 ms avg 17.781 ms med 0.033 ms std 276.043 J write rate 21.793 MB/s (data) 7.525 MB/s (open + 1st byte + data + close) A read dir cnt 4172 min 0.001 ms max 305.283 ms avg 0.269 ms med 0.004 ms std 5.536 B lstat file cnt 3906 min 0.007 ms max 176.262 ms avg 0.088 ms med 0.023 ms std 2.864 C open file cnt 3102 min 0.015 ms max 6.755 ms avg 0.026 ms med 0.017 ms std 0.144 D rd 1st byte cnt 3102 min 0.179 ms max 1162.404 ms avg 5.681 ms med 0.325 ms std 41.027 E read rate 7.533 MB/s (data) 2.771 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23534 min 0.001 ms max 94.437 ms avg 0.062 ms med 0.004 ms std 0.869 B lstat file cnt 21961 min 0.007 ms max 22.380 ms avg 0.028 ms med 0.024 ms std 0.200 C open file cnt 17245 min 0.014 ms max 0.161 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 17245 min 0.176 ms max 99.404 ms avg 0.901 ms med 0.275 ms std 3.773 E read rate 42.508 MB/s (data) 15.790 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 17190 min 0.001 ms max 21.893 ms avg 0.073 ms med 0.003 ms std 0.715 B lstat file cnt 16027 min 0.007 ms max 20.553 ms avg 0.032 ms med 0.020 ms std 0.344 C open file cnt 12539 min 0.014 ms max 0.394 ms avg 0.021 ms med 0.016 ms std 0.018 D rd 1st byte cnt 12539 min 0.175 ms max 103.275 ms avg 1.187 ms med 0.298 ms std 4.231 E read rate 26.669 MB/s (data) 11.212 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6441 min 0.039 ms max 2745.941 ms avg 4.054 ms med 0.046 ms std 75.355 G wr 1st byte cnt 6441 min 0.006 ms max 0.197 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 6441 min 0.011 ms max 0.164 ms avg 0.016 ms med 0.016 ms std 0.007 I mkdir cnt 606 min 0.026 ms max 1214.708 ms avg 4.320 ms med 0.033 ms std 60.320 J write rate 633.098 MB/s (data) 8.938 MB/s (open + 1st byte + data + close) A read dir cnt 31 min 0.002 ms max 409.979 ms avg 13.230 ms med 0.005 ms std 72.436 B lstat file cnt 30 min 0.009 ms max 0.092 ms avg 0.031 ms med 0.030 ms std 0.014 C open file cnt 25 min 0.016 ms max 0.100 ms avg 0.028 ms med 0.022 ms std 0.018 D rd 1st byte cnt 25 min 0.812 ms max 2773.609 ms avg 901.094 ms med 755.612 ms std 798.587 E read rate 0.082 MB/s (data) 0.019 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22820 min 0.001 ms max 100.992 ms avg 0.069 ms med 0.004 ms std 1.162 B lstat file cnt 21294 min 0.007 ms max 15.198 ms avg 0.027 ms med 0.024 ms std 0.180 C open file cnt 16715 min 0.014 ms max 0.183 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 16715 min 0.176 ms max 117.123 ms avg 0.902 ms med 0.275 ms std 3.712 E read rate 39.417 MB/s (data) 15.266 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16755 min 0.001 ms max 99.564 ms avg 0.090 ms med 0.003 ms std 1.208 B lstat file cnt 15622 min 0.007 ms max 112.088 ms avg 0.044 ms med 0.022 ms std 1.137 C open file cnt 12221 min 0.014 ms max 0.373 ms avg 0.020 ms med 0.016 ms std 0.015 D rd 1st byte cnt 12221 min 0.176 ms max 100.907 ms avg 1.236 ms med 0.294 ms std 4.777 E read rate 27.104 MB/s (data) 10.832 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4471 min 0.039 ms max 2607.327 ms avg 5.465 ms med 0.045 ms std 92.947 G wr 1st byte cnt 4471 min 0.006 ms max 0.096 ms avg 0.007 ms med 0.007 ms std 0.003 H write close cnt 4471 min 0.011 ms max 1659.252 ms avg 0.387 ms med 0.015 ms std 24.812 I mkdir cnt 416 min 0.025 ms max 1494.065 ms avg 6.559 ms med 0.033 ms std 94.220 J write rate 573.124 MB/s (data) 5.989 MB/s (open + 1st byte + data + close) A read dir cnt 41 min 0.002 ms max 2416.348 ms avg 89.380 ms med 0.005 ms std 389.835 B lstat file cnt 37 min 0.008 ms max 0.041 ms avg 0.025 ms med 0.026 ms std 0.008 C open file cnt 23 min 0.019 ms max 0.093 ms avg 0.029 ms med 0.023 ms std 0.019 D rd 1st byte cnt 23 min 100.579 ms max 2762.601 ms avg 837.278 ms med 590.268 ms std 723.864 E read rate 0.080 MB/s (data) 0.020 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23104 min 0.001 ms max 99.263 ms avg 0.060 ms med 0.004 ms std 0.834 B lstat file cnt 21568 min 0.007 ms max 18.320 ms avg 0.028 ms med 0.024 ms std 0.207 C open file cnt 16958 min 0.014 ms max 0.318 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 16958 min 0.172 ms max 109.996 ms avg 0.900 ms med 0.280 ms std 3.568 E read rate 40.130 MB/s (data) 15.530 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16674 min 0.001 ms max 92.733 ms avg 0.085 ms med 0.003 ms std 1.221 B lstat file cnt 15547 min 0.007 ms max 53.009 ms avg 0.034 ms med 0.021 ms std 0.518 C open file cnt 12164 min 0.014 ms max 0.439 ms avg 0.021 ms med 0.016 ms std 0.018 D rd 1st byte cnt 12164 min 0.177 ms max 119.677 ms avg 1.265 ms med 0.298 ms std 4.590 E read rate 26.807 MB/s (data) 10.675 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 14438 min 0.038 ms max 3530.492 ms avg 0.984 ms med 0.045 ms std 37.998 G wr 1st byte cnt 14438 min 0.006 ms max 0.786 ms avg 0.007 ms med 0.007 ms std 0.009 H write close cnt 14438 min 0.011 ms max 65.164 ms avg 0.021 ms med 0.015 ms std 0.549 I mkdir cnt 1356 min 0.024 ms max 1797.004 ms avg 1.474 ms med 0.032 ms std 48.863 J write rate 565.033 MB/s (data) 34.205 MB/s (open + 1st byte + data + close) A read dir cnt 1234 min 0.001 ms max 9419.164 ms avg 9.427 ms med 0.003 ms std 271.366 B lstat file cnt 1151 min 0.008 ms max 53.743 ms avg 0.068 ms med 0.019 ms std 1.583 C open file cnt 899 min 0.015 ms max 0.242 ms avg 0.018 ms med 0.017 ms std 0.010 D rd 1st byte cnt 899 min 0.175 ms max 2967.454 ms avg 13.124 ms med 0.281 ms std 127.792 E read rate 4.874 MB/s (data) 0.744 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23695 min 0.001 ms max 56.367 ms avg 0.059 ms med 0.004 ms std 0.658 B lstat file cnt 22112 min 0.007 ms max 76.411 ms avg 0.030 ms med 0.024 ms std 0.537 C open file cnt 17365 min 0.014 ms max 0.308 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 17365 min 0.174 ms max 124.064 ms avg 0.877 ms med 0.277 ms std 3.559 E read rate 41.421 MB/s (data) 15.928 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16231 min 0.001 ms max 54.915 ms avg 0.080 ms med 0.003 ms std 0.869 B lstat file cnt 15138 min 0.007 ms max 20.551 ms avg 0.032 ms med 0.022 ms std 0.357 C open file cnt 11858 min 0.014 ms max 0.536 ms avg 0.021 ms med 0.016 ms std 0.018 D rd 1st byte cnt 11858 min 0.176 ms max 122.403 ms avg 1.304 ms med 0.296 ms std 5.223 E read rate 25.826 MB/s (data) 10.376 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 16703 min 0.039 ms max 6333.646 ms avg 1.234 ms med 0.046 ms std 63.770 G wr 1st byte cnt 16703 min 0.006 ms max 0.538 ms avg 0.007 ms med 0.007 ms std 0.009 H write close cnt 16703 min 0.011 ms max 8.814 ms avg 0.017 ms med 0.016 ms std 0.071 I mkdir cnt 1553 min 0.026 ms max 256.848 ms avg 0.320 ms med 0.034 ms std 6.964 J write rate 627.073 MB/s (data) 27.603 MB/s (open + 1st byte + data + close) A read dir cnt 1486 min 0.001 ms max 49.564 ms avg 0.137 ms med 0.003 ms std 1.586 B lstat file cnt 1386 min 0.007 ms max 20.661 ms avg 0.040 ms med 0.019 ms std 0.571 C open file cnt 1087 min 0.015 ms max 0.164 ms avg 0.019 ms med 0.017 ms std 0.010 D rd 1st byte cnt 1087 min 0.172 ms max 6612.559 ms avg 16.391 ms med 0.280 ms std 272.723 E read rate 5.027 MB/s (data) 1.099 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23400 min 0.001 ms max 97.231 ms avg 0.063 ms med 0.004 ms std 0.979 B lstat file cnt 21841 min 0.007 ms max 18.456 ms avg 0.028 ms med 0.024 ms std 0.193 C open file cnt 17163 min 0.014 ms max 0.315 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 17163 min 0.175 ms max 98.443 ms avg 0.899 ms med 0.281 ms std 3.638 E read rate 41.677 MB/s (data) 15.704 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15725 min 0.001 ms max 138.158 ms avg 0.092 ms med 0.003 ms std 1.614 B lstat file cnt 14670 min 0.007 ms max 20.704 ms avg 0.033 ms med 0.020 ms std 0.349 C open file cnt 11505 min 0.014 ms max 0.429 ms avg 0.021 ms med 0.016 ms std 0.021 D rd 1st byte cnt 11505 min 0.177 ms max 138.565 ms avg 1.418 ms med 0.300 ms std 5.783 E read rate 27.322 MB/s (data) 10.022 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 3901 min 0.039 ms max 95.068 ms avg 0.113 ms med 0.046 ms std 1.751 G wr 1st byte cnt 3901 min 0.006 ms max 0.477 ms avg 0.007 ms med 0.007 ms std 0.009 H write close cnt 3901 min 0.011 ms max 1572.757 ms avg 2.927 ms med 0.016 ms std 58.295 I mkdir cnt 346 min 0.025 ms max 18.063 ms avg 0.116 ms med 0.033 ms std 1.109 J write rate 6.968 MB/s (data) 4.186 MB/s (open + 1st byte + data + close) A read dir cnt 8169 min 0.001 ms max 145.129 ms avg 0.216 ms med 0.004 ms std 3.454 B lstat file cnt 7625 min 0.007 ms max 97.125 ms avg 0.056 ms med 0.022 ms std 1.269 C open file cnt 5992 min 0.014 ms max 4.704 ms avg 0.023 ms med 0.017 ms std 0.071 D rd 1st byte cnt 5992 min 0.179 ms max 201.055 ms avg 2.657 ms med 0.324 ms std 10.335 E read rate 13.956 MB/s (data) 5.383 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23360 min 0.001 ms max 81.089 ms avg 0.070 ms med 0.004 ms std 1.132 B lstat file cnt 21801 min 0.007 ms max 18.089 ms avg 0.027 ms med 0.024 ms std 0.169 C open file cnt 17124 min 0.014 ms max 0.300 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 17124 min 0.177 ms max 96.428 ms avg 0.865 ms med 0.275 ms std 3.314 E read rate 39.533 MB/s (data) 15.602 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15431 min 0.001 ms max 91.465 ms avg 0.089 ms med 0.003 ms std 1.205 B lstat file cnt 14394 min 0.007 ms max 102.214 ms avg 0.039 ms med 0.022 ms std 0.918 C open file cnt 11283 min 0.014 ms max 0.362 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 11283 min 0.176 ms max 117.327 ms avg 1.365 ms med 0.296 ms std 5.169 E read rate 24.734 MB/s (data) 9.903 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4247 min 0.040 ms max 103.250 ms avg 0.141 ms med 0.045 ms std 2.031 G wr 1st byte cnt 4247 min 0.006 ms max 0.748 ms avg 0.007 ms med 0.007 ms std 0.012 H write close cnt 4247 min 0.011 ms max 1599.074 ms avg 1.301 ms med 0.016 ms std 36.894 I mkdir cnt 394 min 0.026 ms max 17.805 ms avg 0.122 ms med 0.032 ms std 1.214 J write rate 6.659 MB/s (data) 5.262 MB/s (open + 1st byte + data + close) A read dir cnt 8093 min 0.001 ms max 69.029 ms avg 0.164 ms med 0.004 ms std 2.029 B lstat file cnt 7552 min 0.007 ms max 19.485 ms avg 0.039 ms med 0.024 ms std 0.401 C open file cnt 5932 min 0.015 ms max 20.144 ms avg 0.026 ms med 0.017 ms std 0.268 D rd 1st byte cnt 5932 min 0.177 ms max 293.150 ms avg 2.874 ms med 0.322 ms std 11.702 E read rate 13.908 MB/s (data) 5.216 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22919 min 0.001 ms max 94.946 ms avg 0.072 ms med 0.004 ms std 1.362 B lstat file cnt 21389 min 0.007 ms max 18.067 ms avg 0.028 ms med 0.024 ms std 0.205 C open file cnt 16802 min 0.014 ms max 0.187 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 16802 min 0.174 ms max 104.295 ms avg 0.913 ms med 0.276 ms std 3.754 E read rate 40.959 MB/s (data) 15.332 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15858 min 0.001 ms max 93.529 ms avg 0.096 ms med 0.003 ms std 1.440 B lstat file cnt 14794 min 0.007 ms max 22.220 ms avg 0.032 ms med 0.023 ms std 0.360 C open file cnt 11601 min 0.014 ms max 0.482 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 11601 min 0.177 ms max 119.674 ms avg 1.347 ms med 0.295 ms std 5.105 E read rate 26.020 MB/s (data) 10.107 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4617 min 0.040 ms max 945.044 ms avg 0.728 ms med 0.046 ms std 22.036 G wr 1st byte cnt 4617 min 0.006 ms max 4.734 ms avg 0.009 ms med 0.007 ms std 0.070 H write close cnt 4617 min 0.011 ms max 1257.220 ms avg 1.248 ms med 0.016 ms std 31.649 I mkdir cnt 429 min 0.025 ms max 34.274 ms avg 0.120 ms med 0.033 ms std 1.651 J write rate 7.146 MB/s (data) 4.961 MB/s (open + 1st byte + data + close) A read dir cnt 7032 min 0.001 ms max 168.843 ms avg 0.203 ms med 0.004 ms std 3.074 B lstat file cnt 6574 min 0.007 ms max 72.280 ms avg 0.061 ms med 0.024 ms std 1.244 C open file cnt 5201 min 0.014 ms max 0.726 ms avg 0.021 ms med 0.017 ms std 0.021 D rd 1st byte cnt 5201 min 0.177 ms max 432.638 ms avg 3.182 ms med 0.328 ms std 13.730 E read rate 11.895 MB/s (data) 4.571 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22850 min 0.001 ms max 113.634 ms avg 0.070 ms med 0.004 ms std 1.332 B lstat file cnt 21323 min 0.007 ms max 88.803 ms avg 0.032 ms med 0.025 ms std 0.641 C open file cnt 16742 min 0.014 ms max 0.242 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 16742 min 0.176 ms max 115.136 ms avg 0.921 ms med 0.279 ms std 3.736 E read rate 41.212 MB/s (data) 15.321 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16441 min 0.001 ms max 88.352 ms avg 0.088 ms med 0.003 ms std 1.203 B lstat file cnt 15330 min 0.007 ms max 81.720 ms avg 0.037 ms med 0.022 ms std 0.744 C open file cnt 11999 min 0.014 ms max 0.496 ms avg 0.020 ms med 0.016 ms std 0.017 D rd 1st byte cnt 11999 min 0.179 ms max 111.931 ms avg 1.273 ms med 0.297 ms std 4.661 E read rate 26.413 MB/s (data) 10.567 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4245 min 0.040 ms max 2873.606 ms avg 1.196 ms med 0.046 ms std 46.930 G wr 1st byte cnt 4245 min 0.006 ms max 0.282 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 4245 min 0.011 ms max 1276.325 ms avg 1.766 ms med 0.018 ms std 40.524 I mkdir cnt 389 min 0.025 ms max 1640.897 ms avg 4.614 ms med 0.033 ms std 83.294 J write rate 8.036 MB/s (data) 4.627 MB/s (open + 1st byte + data + close) A read dir cnt 8576 min 0.001 ms max 130.467 ms avg 0.176 ms med 0.004 ms std 2.433 B lstat file cnt 8014 min 0.007 ms max 19.925 ms avg 0.048 ms med 0.023 ms std 0.592 C open file cnt 6330 min 0.014 ms max 1.123 ms avg 0.021 ms med 0.017 ms std 0.025 D rd 1st byte cnt 6330 min 0.175 ms max 687.811 ms avg 3.085 ms med 0.322 ms std 17.013 E read rate 15.576 MB/s (data) 5.177 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16639 min 0.001 ms max 103.735 ms avg 0.093 ms med 0.004 ms std 1.401 B lstat file cnt 15542 min 0.007 ms max 20.210 ms avg 0.029 ms med 0.025 ms std 0.232 C open file cnt 12251 min 0.015 ms max 0.802 ms avg 0.021 ms med 0.018 ms std 0.013 D rd 1st byte cnt 12251 min 0.176 ms max 356.165 ms avg 1.275 ms med 0.287 ms std 5.701 E read rate 29.289 MB/s (data) 11.298 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15413 min 0.001 ms max 97.866 ms avg 0.094 ms med 0.003 ms std 1.266 B lstat file cnt 14374 min 0.007 ms max 24.639 ms avg 0.031 ms med 0.022 ms std 0.316 C open file cnt 11258 min 0.015 ms max 0.366 ms avg 0.021 ms med 0.017 ms std 0.015 D rd 1st byte cnt 11258 min 0.175 ms max 972.659 ms avg 1.409 ms med 0.294 ms std 10.897 E read rate 25.306 MB/s (data) 9.772 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5034 min 0.040 ms max 2633.756 ms avg 4.383 ms med 0.046 ms std 74.587 G wr 1st byte cnt 5034 min 0.006 ms max 0.135 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 5034 min 0.011 ms max 0.222 ms avg 0.016 ms med 0.016 ms std 0.009 I mkdir cnt 454 min 0.027 ms max 2467.235 ms avg 13.909 ms med 0.034 ms std 156.263 J write rate 617.484 MB/s (data) 8.203 MB/s (open + 1st byte + data + close) A read dir cnt 26 min 0.002 ms max 987.202 ms avg 37.973 ms med 0.005 ms std 189.846 B lstat file cnt 25 min 0.009 ms max 0.055 ms avg 0.029 ms med 0.029 ms std 0.009 C open file cnt 20 min 0.017 ms max 0.065 ms avg 0.025 ms med 0.022 ms std 0.010 D rd 1st byte cnt 20 min 1.676 ms max 1862.741 ms avg 819.978 ms med 865.137 ms std 530.483 E read rate 0.084 MB/s (data) 0.036 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22276 min 0.001 ms max 66.920 ms avg 0.064 ms med 0.004 ms std 0.777 B lstat file cnt 20792 min 0.007 ms max 15.224 ms avg 0.028 ms med 0.024 ms std 0.208 C open file cnt 16335 min 0.014 ms max 0.373 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 16335 min 0.176 ms max 103.937 ms avg 0.947 ms med 0.276 ms std 3.760 E read rate 39.301 MB/s (data) 14.953 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15516 min 0.001 ms max 102.668 ms avg 0.093 ms med 0.003 ms std 1.410 B lstat file cnt 14473 min 0.007 ms max 79.813 ms avg 0.036 ms med 0.023 ms std 0.721 C open file cnt 11344 min 0.014 ms max 0.467 ms avg 0.020 ms med 0.016 ms std 0.015 D rd 1st byte cnt 11344 min 0.175 ms max 123.355 ms avg 1.317 ms med 0.292 ms std 5.132 E read rate 23.981 MB/s (data) 9.962 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5187 min 0.040 ms max 2250.392 ms avg 4.673 ms med 0.046 ms std 70.944 G wr 1st byte cnt 5187 min 0.006 ms max 0.064 ms avg 0.007 ms med 0.007 ms std 0.002 H write close cnt 5187 min 0.011 ms max 0.960 ms avg 0.016 ms med 0.015 ms std 0.014 I mkdir cnt 461 min 0.027 ms max 3322.250 ms avg 11.816 ms med 0.033 ms std 174.823 J write rate 664.661 MB/s (data) 7.602 MB/s (open + 1st byte + data + close) A read dir cnt 39 min 0.002 ms max 834.293 ms avg 45.068 ms med 0.004 ms std 177.582 B lstat file cnt 35 min 0.009 ms max 0.132 ms avg 0.034 ms med 0.029 ms std 0.022 C open file cnt 24 min 0.017 ms max 0.079 ms avg 0.027 ms med 0.023 ms std 0.013 D rd 1st byte cnt 24 min 0.291 ms max 3003.831 ms avg 896.075 ms med 744.871 ms std 742.030 E read rate 0.089 MB/s (data) 0.025 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23402 min 0.001 ms max 81.834 ms avg 0.060 ms med 0.004 ms std 0.766 B lstat file cnt 21840 min 0.007 ms max 20.414 ms avg 0.028 ms med 0.025 ms std 0.201 C open file cnt 17154 min 0.014 ms max 0.233 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 17154 min 0.175 ms max 114.793 ms avg 0.873 ms med 0.276 ms std 3.434 E read rate 39.645 MB/s (data) 15.700 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16747 min 0.001 ms max 119.933 ms avg 0.097 ms med 0.003 ms std 1.575 B lstat file cnt 15621 min 0.007 ms max 17.889 ms avg 0.030 ms med 0.022 ms std 0.280 C open file cnt 12240 min 0.014 ms max 0.363 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 12240 min 0.178 ms max 114.319 ms avg 1.231 ms med 0.292 ms std 4.857 E read rate 26.876 MB/s (data) 10.837 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 648 min 0.039 ms max 1235.376 ms avg 5.592 ms med 0.045 ms std 72.377 G wr 1st byte cnt 648 min 0.006 ms max 0.068 ms avg 0.007 ms med 0.007 ms std 0.006 H write close cnt 648 min 0.011 ms max 0.102 ms avg 0.015 ms med 0.015 ms std 0.006 I mkdir cnt 59 min 0.027 ms max 8586.127 ms avg 158.014 ms med 0.036 ms std 1110.653 J write rate 634.357 MB/s (data) 6.741 MB/s (open + 1st byte + data + close) A read dir cnt 5 min 0.005 ms max 0.006 ms avg 0.005 ms med 0.005 ms std 0.000 B lstat file cnt 5 min 0.027 ms max 0.037 ms avg 0.031 ms med 0.031 ms std 0.003 C open file cnt 5 min 0.021 ms max 0.024 ms avg 0.022 ms med 0.022 ms std 0.001 D rd 1st byte cnt 5 min 346.787 ms max 1348.562 ms avg 717.255 ms med 565.722 ms std 353.849 E read rate 0.014 MB/s (data) 0.010 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=int data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23004 min 0.001 ms max 93.000 ms avg 0.070 ms med 0.004 ms std 1.199 B lstat file cnt 21469 min 0.007 ms max 17.943 ms avg 0.029 ms med 0.025 ms std 0.223 C open file cnt 16864 min 0.014 ms max 0.284 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 16864 min 0.177 ms max 101.307 ms avg 0.914 ms med 0.281 ms std 3.562 E read rate 41.392 MB/s (data) 15.473 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16752 min 0.001 ms max 97.406 ms avg 0.094 ms med 0.003 ms std 1.498 B lstat file cnt 15626 min 0.007 ms max 23.069 ms avg 0.033 ms med 0.023 ms std 0.366 C open file cnt 12244 min 0.014 ms max 0.381 ms avg 0.020 ms med 0.016 ms std 0.014 D rd 1st byte cnt 12244 min 0.177 ms max 100.579 ms avg 1.233 ms med 0.293 ms std 4.616 E read rate 26.855 MB/s (data) 10.839 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 9220 min 0.040 ms max 15835.793 ms avg 2.646 ms med 0.046 ms std 177.839 G wr 1st byte cnt 9220 min 0.006 ms max 0.319 ms avg 0.007 ms med 0.007 ms std 0.008 H write close cnt 9220 min 0.011 ms max 0.417 ms avg 0.016 ms med 0.016 ms std 0.012 I mkdir cnt 853 min 0.025 ms max 612.279 ms avg 1.012 ms med 0.033 ms std 21.422 J write rate 610.325 MB/s (data) 13.215 MB/s (open + 1st byte + data + close) A read dir cnt 525 min 0.001 ms max 1693.050 ms avg 3.295 ms med 0.003 ms std 73.820 B lstat file cnt 486 min 0.008 ms max 17.528 ms avg 0.056 ms med 0.019 ms std 0.793 C open file cnt 368 min 0.015 ms max 0.250 ms avg 0.019 ms med 0.017 ms std 0.014 D rd 1st byte cnt 368 min 0.183 ms max 5372.871 ms avg 32.719 ms med 0.267 ms std 371.000 E read rate 0.738 MB/s (data) 0.356 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23732 min 0.001 ms max 78.505 ms avg 0.062 ms med 0.004 ms std 0.908 B lstat file cnt 22147 min 0.007 ms max 10.961 ms avg 0.027 ms med 0.024 ms std 0.143 C open file cnt 17392 min 0.014 ms max 0.223 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 17392 min 0.176 ms max 114.599 ms avg 0.870 ms med 0.275 ms std 3.302 E read rate 41.039 MB/s (data) 15.896 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16064 min 0.001 ms max 70.046 ms avg 0.082 ms med 0.003 ms std 0.964 B lstat file cnt 14983 min 0.007 ms max 22.973 ms avg 0.031 ms med 0.022 ms std 0.332 C open file cnt 11741 min 0.014 ms max 0.516 ms avg 0.021 ms med 0.016 ms std 0.017 D rd 1st byte cnt 11741 min 0.177 ms max 113.652 ms avg 1.347 ms med 0.295 ms std 5.287 E read rate 26.513 MB/s (data) 10.303 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 2501 min 0.040 ms max 18644.136 ms avg 7.548 ms med 0.047 ms std 372.733 G wr 1st byte cnt 2501 min 0.006 ms max 0.200 ms avg 0.007 ms med 0.007 ms std 0.006 H write close cnt 2501 min 0.017 ms max 0.436 ms avg 0.028 ms med 0.024 ms std 0.018 I mkdir cnt 216 min 0.027 ms max 11.451 ms avg 0.089 ms med 0.034 ms std 0.775 J write rate 300.615 MB/s (data) 4.812 MB/s (open + 1st byte + data + close) A read dir cnt 7569 min 0.001 ms max 86.003 ms avg 0.172 ms med 0.004 ms std 2.011 B lstat file cnt 7074 min 0.007 ms max 27.535 ms avg 0.044 ms med 0.024 ms std 0.554 C open file cnt 5589 min 0.015 ms max 3.723 ms avg 0.022 ms med 0.017 ms std 0.064 D rd 1st byte cnt 5589 min 0.180 ms max 276.175 ms avg 2.899 ms med 0.336 ms std 11.021 E read rate 12.472 MB/s (data) 4.947 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22457 min 0.001 ms max 105.652 ms avg 0.069 ms med 0.004 ms std 1.159 B lstat file cnt 20960 min 0.007 ms max 12.943 ms avg 0.027 ms med 0.025 ms std 0.138 C open file cnt 16465 min 0.014 ms max 0.176 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 16465 min 0.177 ms max 105.849 ms avg 0.944 ms med 0.285 ms std 3.994 E read rate 40.253 MB/s (data) 15.039 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16742 min 0.001 ms max 103.921 ms avg 0.107 ms med 0.003 ms std 1.809 B lstat file cnt 15610 min 0.007 ms max 26.802 ms avg 0.034 ms med 0.022 ms std 0.412 C open file cnt 12212 min 0.014 ms max 0.455 ms avg 0.021 ms med 0.016 ms std 0.017 D rd 1st byte cnt 12212 min 0.177 ms max 114.683 ms avg 1.256 ms med 0.294 ms std 4.703 E read rate 27.872 MB/s (data) 10.745 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1949 min 0.041 ms max 197.157 ms avg 0.322 ms med 0.047 ms std 5.461 G wr 1st byte cnt 1949 min 0.006 ms max 0.146 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 1949 min 0.016 ms max 0.308 ms avg 0.027 ms med 0.023 ms std 0.015 I mkdir cnt 169 min 0.027 ms max 91.594 ms avg 0.576 ms med 0.034 ms std 7.022 J write rate 3.158 MB/s (data) 3.070 MB/s (open + 1st byte + data + close) A read dir cnt 7307 min 0.001 ms max 278.102 ms avg 0.238 ms med 0.004 ms std 4.708 B lstat file cnt 6830 min 0.007 ms max 97.212 ms avg 0.057 ms med 0.025 ms std 1.279 C open file cnt 5404 min 0.015 ms max 1.430 ms avg 0.021 ms med 0.017 ms std 0.033 D rd 1st byte cnt 5404 min 0.175 ms max 334.449 ms avg 3.185 ms med 0.334 ms std 12.192 E read rate 12.602 MB/s (data) 4.645 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23397 min 0.001 ms max 81.887 ms avg 0.058 ms med 0.004 ms std 0.848 B lstat file cnt 21836 min 0.007 ms max 73.985 ms avg 0.032 ms med 0.025 ms std 0.553 C open file cnt 17155 min 0.014 ms max 0.454 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 17155 min 0.174 ms max 102.495 ms avg 0.875 ms med 0.279 ms std 3.287 E read rate 39.962 MB/s (data) 15.726 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15871 min 0.001 ms max 92.902 ms avg 0.095 ms med 0.003 ms std 1.404 B lstat file cnt 14806 min 0.007 ms max 22.847 ms avg 0.032 ms med 0.023 ms std 0.350 C open file cnt 11611 min 0.014 ms max 0.473 ms avg 0.020 ms med 0.017 ms std 0.015 D rd 1st byte cnt 11611 min 0.173 ms max 127.942 ms avg 1.348 ms med 0.294 ms std 5.360 E read rate 26.113 MB/s (data) 10.117 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 3072 min 0.040 ms max 18607.022 ms avg 6.285 ms med 0.046 ms std 335.670 G wr 1st byte cnt 3072 min 0.006 ms max 0.169 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 3072 min 0.016 ms max 0.238 ms avg 0.028 ms med 0.023 ms std 0.017 I mkdir cnt 261 min 0.024 ms max 78.407 ms avg 0.339 ms med 0.033 ms std 4.842 J write rate 228.508 MB/s (data) 5.839 MB/s (open + 1st byte + data + close) A read dir cnt 6718 min 0.001 ms max 180.610 ms avg 0.250 ms med 0.004 ms std 4.117 B lstat file cnt 6273 min 0.007 ms max 130.077 ms avg 0.077 ms med 0.023 ms std 1.854 C open file cnt 4942 min 0.015 ms max 1.411 ms avg 0.021 ms med 0.017 ms std 0.028 D rd 1st byte cnt 4942 min 0.179 ms max 397.990 ms avg 3.369 ms med 0.334 ms std 15.305 E read rate 11.970 MB/s (data) 4.387 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=journal scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23306 min 0.001 ms max 66.918 ms avg 0.059 ms med 0.004 ms std 0.690 B lstat file cnt 21753 min 0.007 ms max 18.047 ms avg 0.027 ms med 0.024 ms std 0.189 C open file cnt 17093 min 0.014 ms max 0.262 ms avg 0.020 ms med 0.017 ms std 0.011 D rd 1st byte cnt 17093 min 0.176 ms max 119.913 ms avg 0.885 ms med 0.281 ms std 3.592 E read rate 39.760 MB/s (data) 15.593 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16369 min 0.001 ms max 106.670 ms avg 0.085 ms med 0.003 ms std 1.178 B lstat file cnt 15267 min 0.007 ms max 72.980 ms avg 0.036 ms med 0.021 ms std 0.691 C open file cnt 11959 min 0.014 ms max 0.501 ms avg 0.021 ms med 0.016 ms std 0.018 D rd 1st byte cnt 11959 min 0.178 ms max 129.274 ms avg 1.274 ms med 0.297 ms std 4.427 E read rate 26.071 MB/s (data) 10.519 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 1957 min 0.041 ms max 12240.485 ms avg 6.338 ms med 0.047 ms std 276.626 G wr 1st byte cnt 1957 min 0.006 ms max 0.152 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 1957 min 0.016 ms max 0.189 ms avg 0.028 ms med 0.024 ms std 0.014 I mkdir cnt 167 min 0.028 ms max 5.436 ms avg 0.069 ms med 0.035 ms std 0.417 J write rate 300.738 MB/s (data) 6.073 MB/s (open + 1st byte + data + close) A read dir cnt 7160 min 0.001 ms max 103.584 ms avg 0.176 ms med 0.004 ms std 2.309 B lstat file cnt 6693 min 0.007 ms max 14.848 ms avg 0.037 ms med 0.024 ms std 0.337 C open file cnt 5290 min 0.014 ms max 2.073 ms avg 0.022 ms med 0.017 ms std 0.035 D rd 1st byte cnt 5290 min 0.180 ms max 887.074 ms avg 2.801 ms med 0.333 ms std 15.523 E read rate 10.454 MB/s (data) 4.668 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22676 min 0.001 ms max 97.418 ms avg 0.061 ms med 0.004 ms std 1.029 B lstat file cnt 21162 min 0.007 ms max 22.888 ms avg 0.028 ms med 0.024 ms std 0.208 C open file cnt 16624 min 0.014 ms max 0.187 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 16624 min 0.174 ms max 98.458 ms avg 0.916 ms med 0.276 ms std 3.899 E read rate 38.850 MB/s (data) 15.140 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16406 min 0.001 ms max 93.567 ms avg 0.087 ms med 0.003 ms std 1.232 B lstat file cnt 15300 min 0.007 ms max 120.287 ms avg 0.040 ms med 0.021 ms std 1.133 C open file cnt 11979 min 0.014 ms max 0.654 ms avg 0.021 ms med 0.016 ms std 0.019 D rd 1st byte cnt 11979 min 0.175 ms max 119.423 ms avg 1.267 ms med 0.297 ms std 4.910 E read rate 26.242 MB/s (data) 10.580 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 8167 min 0.040 ms max 6518.626 ms avg 2.573 ms med 0.046 ms std 96.064 G wr 1st byte cnt 8167 min 0.006 ms max 0.236 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 8167 min 0.016 ms max 0.194 ms avg 0.027 ms med 0.023 ms std 0.014 I mkdir cnt 788 min 0.024 ms max 480.260 ms avg 1.783 ms med 0.034 ms std 28.314 J write rate 29.135 MB/s (data) 9.580 MB/s (open + 1st byte + data + close) A read dir cnt 328 min 0.002 ms max 983.374 ms avg 8.458 ms med 0.004 ms std 70.957 B lstat file cnt 303 min 0.008 ms max 9.267 ms avg 0.056 ms med 0.022 ms std 0.530 C open file cnt 226 min 0.015 ms max 0.169 ms avg 0.022 ms med 0.017 ms std 0.020 D rd 1st byte cnt 226 min 0.182 ms max 1852.449 ms avg 90.823 ms med 0.399 ms std 251.007 E read rate 0.585 MB/s (data) 0.167 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23221 min 0.001 ms max 90.462 ms avg 0.058 ms med 0.004 ms std 0.787 B lstat file cnt 21672 min 0.007 ms max 20.220 ms avg 0.027 ms med 0.024 ms std 0.190 C open file cnt 17027 min 0.014 ms max 0.222 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 17027 min 0.176 ms max 110.832 ms avg 0.925 ms med 0.274 ms std 3.980 E read rate 41.830 MB/s (data) 15.521 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16251 min 0.001 ms max 105.740 ms avg 0.097 ms med 0.003 ms std 1.332 B lstat file cnt 15156 min 0.007 ms max 21.473 ms avg 0.032 ms med 0.022 ms std 0.356 C open file cnt 11871 min 0.014 ms max 0.605 ms avg 0.021 ms med 0.016 ms std 0.020 D rd 1st byte cnt 11871 min 0.172 ms max 129.644 ms avg 1.281 ms med 0.292 ms std 5.033 E read rate 25.986 MB/s (data) 10.405 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 8247 min 0.040 ms max 6504.014 ms avg 2.297 ms med 0.046 ms std 94.345 G wr 1st byte cnt 8247 min 0.006 ms max 0.071 ms avg 0.007 ms med 0.007 ms std 0.003 H write close cnt 8247 min 0.016 ms max 0.248 ms avg 0.026 ms med 0.023 ms std 0.015 I mkdir cnt 798 min 0.025 ms max 620.217 ms avg 1.550 ms med 0.033 ms std 26.122 J write rate 26.066 MB/s (data) 9.906 MB/s (open + 1st byte + data + close) A read dir cnt 108 min 0.002 ms max 1442.030 ms avg 27.521 ms med 0.004 ms std 160.432 B lstat file cnt 103 min 0.008 ms max 0.090 ms avg 0.028 ms med 0.027 ms std 0.012 C open file cnt 87 min 0.015 ms max 0.100 ms avg 0.021 ms med 0.019 ms std 0.011 D rd 1st byte cnt 87 min 0.191 ms max 2203.262 ms avg 232.025 ms med 20.479 ms std 435.472 E read rate 0.218 MB/s (data) 0.064 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23017 min 0.001 ms max 84.606 ms avg 0.075 ms med 0.004 ms std 1.180 B lstat file cnt 21476 min 0.007 ms max 50.465 ms avg 0.029 ms med 0.024 ms std 0.384 C open file cnt 16858 min 0.014 ms max 0.182 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 16858 min 0.176 ms max 98.861 ms avg 0.899 ms med 0.278 ms std 3.643 E read rate 40.840 MB/s (data) 15.421 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16452 min 0.001 ms max 106.222 ms avg 0.093 ms med 0.003 ms std 1.425 B lstat file cnt 15340 min 0.007 ms max 40.922 ms avg 0.035 ms med 0.020 ms std 0.494 C open file cnt 12002 min 0.014 ms max 0.407 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 12002 min 0.176 ms max 111.987 ms avg 1.239 ms med 0.299 ms std 4.942 E read rate 25.609 MB/s (data) 10.565 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 8235 min 0.040 ms max 5629.605 ms avg 1.472 ms med 0.047 ms std 64.766 G wr 1st byte cnt 8235 min 0.006 ms max 0.221 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 8235 min 0.016 ms max 0.298 ms avg 0.027 ms med 0.024 ms std 0.014 I mkdir cnt 771 min 0.026 ms max 1267.734 ms avg 2.775 ms med 0.034 ms std 50.516 J write rate 14.533 MB/s (data) 9.223 MB/s (open + 1st byte + data + close) A read dir cnt 95 min 0.002 ms max 713.487 ms avg 10.439 ms med 0.004 ms std 74.792 B lstat file cnt 89 min 0.008 ms max 0.110 ms avg 0.029 ms med 0.027 ms std 0.019 C open file cnt 70 min 0.015 ms max 0.118 ms avg 0.025 ms med 0.021 ms std 0.016 D rd 1st byte cnt 70 min 0.227 ms max 3701.472 ms avg 376.135 ms med 66.909 ms std 663.232 E read rate 0.227 MB/s (data) 0.055 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=journal scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23016 min 0.001 ms max 67.263 ms avg 0.063 ms med 0.004 ms std 0.783 B lstat file cnt 21483 min 0.007 ms max 17.417 ms avg 0.027 ms med 0.025 ms std 0.165 C open file cnt 16883 min 0.014 ms max 0.181 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 16883 min 0.175 ms max 102.648 ms avg 0.914 ms med 0.279 ms std 3.762 E read rate 40.558 MB/s (data) 15.406 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16817 min 0.001 ms max 102.261 ms avg 0.092 ms med 0.003 ms std 1.375 B lstat file cnt 15680 min 0.007 ms max 20.647 ms avg 0.031 ms med 0.021 ms std 0.331 C open file cnt 12264 min 0.014 ms max 0.497 ms avg 0.021 ms med 0.016 ms std 0.018 D rd 1st byte cnt 12264 min 0.178 ms max 128.802 ms avg 1.289 ms med 0.298 ms std 5.185 E read rate 28.460 MB/s (data) 10.784 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 8025 min 0.040 ms max 4740.045 ms avg 1.902 ms med 0.046 ms std 57.625 G wr 1st byte cnt 8025 min 0.006 ms max 0.074 ms avg 0.007 ms med 0.007 ms std 0.003 H write close cnt 8025 min 0.016 ms max 6706.840 ms avg 0.867 ms med 0.023 ms std 74.864 I mkdir cnt 760 min 0.026 ms max 58.151 ms avg 0.298 ms med 0.033 ms std 3.338 J write rate 49.742 MB/s (data) 10.685 MB/s (open + 1st byte + data + close) A read dir cnt 96 min 0.001 ms max 2607.805 ms avg 54.603 ms med 0.005 ms std 331.705 B lstat file cnt 92 min 0.009 ms max 0.129 ms avg 0.031 ms med 0.028 ms std 0.017 C open file cnt 76 min 0.016 ms max 0.031 ms avg 0.022 ms med 0.022 ms std 0.004 D rd 1st byte cnt 76 min 0.218 ms max 2086.721 ms avg 258.624 ms med 71.248 ms std 362.899 E read rate 0.324 MB/s (data) 0.046 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23537 min 0.001 ms max 88.099 ms avg 0.064 ms med 0.004 ms std 1.019 B lstat file cnt 21968 min 0.007 ms max 97.830 ms avg 0.032 ms med 0.025 ms std 0.685 C open file cnt 17263 min 0.014 ms max 0.174 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 17263 min 0.178 ms max 96.332 ms avg 0.877 ms med 0.280 ms std 3.350 E read rate 41.393 MB/s (data) 15.868 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15622 min 0.001 ms max 108.698 ms avg 0.095 ms med 0.003 ms std 1.361 B lstat file cnt 14572 min 0.007 ms max 26.369 ms avg 0.033 ms med 0.023 ms std 0.354 C open file cnt 11421 min 0.015 ms max 0.266 ms avg 0.020 ms med 0.017 ms std 0.013 D rd 1st byte cnt 11421 min 0.178 ms max 138.505 ms avg 1.312 ms med 0.295 ms std 4.754 E read rate 24.273 MB/s (data) 10.016 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5364 min 0.041 ms max 1604.204 ms avg 0.405 ms med 0.047 ms std 21.980 G wr 1st byte cnt 5364 min 0.006 ms max 0.419 ms avg 0.007 ms med 0.007 ms std 0.008 H write close cnt 5364 min 0.011 ms max 2128.445 ms avg 1.329 ms med 0.017 ms std 39.354 I mkdir cnt 490 min 0.026 ms max 1039.008 ms avg 2.528 ms med 0.033 ms std 47.242 J write rate 8.110 MB/s (data) 5.698 MB/s (open + 1st byte + data + close) A read dir cnt 5916 min 0.001 ms max 114.718 ms avg 0.243 ms med 0.004 ms std 3.678 B lstat file cnt 5531 min 0.008 ms max 99.922 ms avg 0.094 ms med 0.025 ms std 1.941 C open file cnt 4382 min 0.015 ms max 1.918 ms avg 0.022 ms med 0.018 ms std 0.034 D rd 1st byte cnt 4382 min 0.179 ms max 632.008 ms avg 3.857 ms med 0.332 ms std 20.912 E read rate 8.363 MB/s (data) 3.542 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 24057 min 0.001 ms max 95.756 ms avg 0.067 ms med 0.004 ms std 1.119 B lstat file cnt 22448 min 0.007 ms max 16.931 ms avg 0.027 ms med 0.024 ms std 0.180 C open file cnt 17619 min 0.014 ms max 0.252 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 17619 min 0.177 ms max 91.310 ms avg 0.851 ms med 0.277 ms std 3.274 E read rate 41.697 MB/s (data) 16.129 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16087 min 0.001 ms max 103.792 ms avg 0.092 ms med 0.003 ms std 1.340 B lstat file cnt 15008 min 0.007 ms max 34.712 ms avg 0.034 ms med 0.022 ms std 0.417 C open file cnt 11771 min 0.014 ms max 0.370 ms avg 0.020 ms med 0.017 ms std 0.014 D rd 1st byte cnt 11771 min 0.177 ms max 109.843 ms avg 1.269 ms med 0.293 ms std 4.341 E read rate 24.924 MB/s (data) 10.298 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4200 min 0.040 ms max 607.925 ms avg 0.428 ms med 0.046 ms std 12.347 G wr 1st byte cnt 4200 min 0.006 ms max 0.497 ms avg 0.007 ms med 0.007 ms std 0.010 H write close cnt 4200 min 0.011 ms max 1969.198 ms avg 2.323 ms med 0.016 ms std 56.736 I mkdir cnt 375 min 0.027 ms max 1375.079 ms avg 5.145 ms med 0.033 ms std 75.980 J write rate 7.869 MB/s (data) 4.716 MB/s (open + 1st byte + data + close) A read dir cnt 6603 min 0.001 ms max 69.979 ms avg 0.136 ms med 0.004 ms std 1.499 B lstat file cnt 6168 min 0.007 ms max 18.541 ms avg 0.039 ms med 0.024 ms std 0.412 C open file cnt 4861 min 0.014 ms max 4.685 ms avg 0.023 ms med 0.017 ms std 0.090 D rd 1st byte cnt 4861 min 0.181 ms max 531.078 ms avg 3.521 ms med 0.334 ms std 16.644 E read rate 10.412 MB/s (data) 4.242 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23084 min 0.001 ms max 67.368 ms avg 0.059 ms med 0.004 ms std 0.728 B lstat file cnt 21546 min 0.007 ms max 12.427 ms avg 0.027 ms med 0.024 ms std 0.152 C open file cnt 16933 min 0.014 ms max 0.238 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 16933 min 0.178 ms max 105.256 ms avg 0.879 ms med 0.286 ms std 3.464 E read rate 38.567 MB/s (data) 15.472 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16026 min 0.001 ms max 92.821 ms avg 0.091 ms med 0.003 ms std 1.407 B lstat file cnt 14948 min 0.007 ms max 23.235 ms avg 0.033 ms med 0.022 ms std 0.364 C open file cnt 11713 min 0.014 ms max 0.540 ms avg 0.020 ms med 0.016 ms std 0.017 D rd 1st byte cnt 11713 min 0.175 ms max 133.554 ms avg 1.319 ms med 0.295 ms std 5.041 E read rate 26.163 MB/s (data) 10.319 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4895 min 0.039 ms max 3476.405 ms avg 1.045 ms med 0.045 ms std 50.196 G wr 1st byte cnt 4895 min 0.006 ms max 26.400 ms avg 0.013 ms med 0.007 ms std 0.377 H write close cnt 4895 min 0.011 ms max 1221.362 ms avg 1.378 ms med 0.016 ms std 34.458 I mkdir cnt 451 min 0.025 ms max 5083.453 ms avg 11.510 ms med 0.032 ms std 239.120 J write rate 10.332 MB/s (data) 5.799 MB/s (open + 1st byte + data + close) A read dir cnt 6879 min 0.001 ms max 86.678 ms avg 0.136 ms med 0.004 ms std 1.727 B lstat file cnt 6434 min 0.007 ms max 103.940 ms avg 0.055 ms med 0.023 ms std 1.349 C open file cnt 5099 min 0.014 ms max 1.916 ms avg 0.022 ms med 0.017 ms std 0.039 D rd 1st byte cnt 5099 min 0.179 ms max 957.665 ms avg 3.336 ms med 0.329 ms std 19.831 E read rate 9.884 MB/s (data) 4.281 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=ordered scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23319 min 0.001 ms max 102.572 ms avg 0.070 ms med 0.004 ms std 1.308 B lstat file cnt 21762 min 0.007 ms max 9.861 ms avg 0.027 ms med 0.025 ms std 0.130 C open file cnt 17091 min 0.014 ms max 0.218 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 17091 min 0.176 ms max 100.873 ms avg 0.927 ms med 0.276 ms std 3.994 E read rate 43.630 MB/s (data) 15.570 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16195 min 0.001 ms max 108.189 ms avg 0.087 ms med 0.003 ms std 1.279 B lstat file cnt 15106 min 0.007 ms max 58.141 ms avg 0.036 ms med 0.023 ms std 0.615 C open file cnt 11837 min 0.014 ms max 0.362 ms avg 0.020 ms med 0.017 ms std 0.015 D rd 1st byte cnt 11837 min 0.177 ms max 103.358 ms avg 1.258 ms med 0.292 ms std 4.393 E read rate 25.009 MB/s (data) 10.400 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4265 min 0.040 ms max 64.813 ms avg 0.123 ms med 0.046 ms std 1.438 G wr 1st byte cnt 4265 min 0.006 ms max 0.327 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 4265 min 0.011 ms max 1493.980 ms avg 0.716 ms med 0.016 ms std 25.205 I mkdir cnt 377 min 0.027 ms max 2875.594 ms avg 14.404 ms med 0.032 ms std 175.343 J write rate 6.340 MB/s (data) 5.438 MB/s (open + 1st byte + data + close) A read dir cnt 7174 min 0.001 ms max 68.458 ms avg 0.156 ms med 0.004 ms std 1.930 B lstat file cnt 6700 min 0.007 ms max 21.163 ms avg 0.041 ms med 0.024 ms std 0.485 C open file cnt 5280 min 0.014 ms max 4.017 ms avg 0.022 ms med 0.017 ms std 0.061 D rd 1st byte cnt 5280 min 0.177 ms max 420.244 ms avg 3.275 ms med 0.324 ms std 14.630 E read rate 11.656 MB/s (data) 4.552 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23070 min 0.001 ms max 96.262 ms avg 0.059 ms med 0.004 ms std 0.813 B lstat file cnt 21534 min 0.007 ms max 36.652 ms avg 0.030 ms med 0.025 ms std 0.330 C open file cnt 16927 min 0.014 ms max 0.244 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 16927 min 0.176 ms max 96.432 ms avg 0.902 ms med 0.278 ms std 3.634 E read rate 40.047 MB/s (data) 15.488 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16443 min 0.001 ms max 104.365 ms avg 0.100 ms med 0.004 ms std 1.476 B lstat file cnt 15333 min 0.007 ms max 38.662 ms avg 0.034 ms med 0.022 ms std 0.456 C open file cnt 12003 min 0.014 ms max 0.469 ms avg 0.021 ms med 0.016 ms std 0.017 D rd 1st byte cnt 12003 min 0.175 ms max 133.802 ms avg 1.259 ms med 0.297 ms std 4.742 E read rate 26.338 MB/s (data) 10.536 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6049 min 0.039 ms max 2273.206 ms avg 4.120 ms med 0.046 ms std 69.215 G wr 1st byte cnt 6049 min 0.006 ms max 0.130 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 6049 min 0.011 ms max 0.843 ms avg 0.016 ms med 0.015 ms std 0.014 I mkdir cnt 557 min 0.025 ms max 1454.838 ms avg 7.498 ms med 0.033 ms std 96.418 J write rate 642.439 MB/s (data) 8.937 MB/s (open + 1st byte + data + close) A read dir cnt 49 min 0.002 ms max 2437.180 ms avg 142.732 ms med 0.004 ms std 468.908 B lstat file cnt 42 min 0.009 ms max 0.040 ms avg 0.024 ms med 0.027 ms std 0.008 C open file cnt 22 min 0.017 ms max 0.147 ms avg 0.033 ms med 0.023 ms std 0.033 D rd 1st byte cnt 22 min 99.915 ms max 2339.223 ms avg 859.834 ms med 782.953 ms std 557.222 E read rate 0.170 MB/s (data) 0.020 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22790 min 0.001 ms max 81.479 ms avg 0.067 ms med 0.004 ms std 1.026 B lstat file cnt 21272 min 0.007 ms max 18.786 ms avg 0.028 ms med 0.024 ms std 0.211 C open file cnt 16716 min 0.014 ms max 0.357 ms avg 0.020 ms med 0.017 ms std 0.011 D rd 1st byte cnt 16716 min 0.175 ms max 132.026 ms avg 0.891 ms med 0.280 ms std 3.445 E read rate 38.598 MB/s (data) 15.266 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16735 min 0.001 ms max 131.952 ms avg 0.086 ms med 0.003 ms std 1.402 B lstat file cnt 15609 min 0.007 ms max 42.920 ms avg 0.036 ms med 0.020 ms std 0.561 C open file cnt 12229 min 0.014 ms max 0.449 ms avg 0.020 ms med 0.016 ms std 0.018 D rd 1st byte cnt 12229 min 0.176 ms max 127.938 ms avg 1.236 ms med 0.295 ms std 4.810 E read rate 26.712 MB/s (data) 10.853 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 13637 min 0.038 ms max 1669.521 ms avg 1.413 ms med 0.044 ms std 33.966 G wr 1st byte cnt 13637 min 0.006 ms max 0.166 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 13637 min 0.011 ms max 9.117 ms avg 0.016 ms med 0.015 ms std 0.078 I mkdir cnt 1246 min 0.024 ms max 2904.103 ms avg 6.261 ms med 0.032 ms std 100.411 J write rate 598.739 MB/s (data) 23.823 MB/s (open + 1st byte + data + close) A read dir cnt 48 min 0.002 ms max 647.597 ms avg 27.286 ms med 0.004 ms std 125.744 B lstat file cnt 43 min 0.009 ms max 0.102 ms avg 0.028 ms med 0.027 ms std 0.014 C open file cnt 33 min 0.016 ms max 0.031 ms avg 0.022 ms med 0.022 ms std 0.004 D rd 1st byte cnt 33 min 0.283 ms max 2373.087 ms avg 668.135 ms med 643.500 ms std 568.497 E read rate 0.115 MB/s (data) 0.023 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23061 min 0.001 ms max 69.937 ms avg 0.059 ms med 0.004 ms std 0.779 B lstat file cnt 21525 min 0.007 ms max 53.035 ms avg 0.029 ms med 0.024 ms std 0.393 C open file cnt 16917 min 0.014 ms max 0.297 ms avg 0.020 ms med 0.018 ms std 0.010 D rd 1st byte cnt 16917 min 0.176 ms max 97.421 ms avg 0.896 ms med 0.276 ms std 3.609 E read rate 39.465 MB/s (data) 15.459 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16473 min 0.001 ms max 66.946 ms avg 0.086 ms med 0.003 ms std 0.940 B lstat file cnt 15361 min 0.007 ms max 19.407 ms avg 0.031 ms med 0.021 ms std 0.332 C open file cnt 12023 min 0.014 ms max 0.361 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 12023 min 0.174 ms max 107.044 ms avg 1.256 ms med 0.297 ms std 4.448 E read rate 25.783 MB/s (data) 10.561 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 7252 min 0.039 ms max 2156.470 ms avg 3.276 ms med 0.045 ms std 59.850 G wr 1st byte cnt 7252 min 0.006 ms max 0.168 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 7252 min 0.011 ms max 1.142 ms avg 0.016 ms med 0.016 ms std 0.017 I mkdir cnt 666 min 0.026 ms max 2456.106 ms avg 8.083 ms med 0.033 ms std 109.435 J write rate 660.971 MB/s (data) 10.861 MB/s (open + 1st byte + data + close) A read dir cnt 36 min 0.002 ms max 1434.618 ms avg 40.605 ms med 0.005 ms std 235.673 B lstat file cnt 34 min 0.009 ms max 0.091 ms avg 0.034 ms med 0.029 ms std 0.018 C open file cnt 27 min 0.018 ms max 0.058 ms avg 0.025 ms med 0.023 ms std 0.007 D rd 1st byte cnt 27 min 28.731 ms max 2228.716 ms avg 794.159 ms med 643.201 ms std 541.518 E read rate 0.096 MB/s (data) 0.024 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=ordered scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23507 min 0.001 ms max 58.551 ms avg 0.057 ms med 0.004 ms std 0.647 B lstat file cnt 21933 min 0.007 ms max 99.062 ms avg 0.034 ms med 0.024 ms std 0.820 C open file cnt 17216 min 0.014 ms max 0.300 ms avg 0.020 ms med 0.017 ms std 0.011 D rd 1st byte cnt 17216 min 0.176 ms max 98.210 ms avg 0.877 ms med 0.279 ms std 3.442 E read rate 40.457 MB/s (data) 15.797 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16905 min 0.001 ms max 107.393 ms avg 0.089 ms med 0.003 ms std 1.301 B lstat file cnt 15764 min 0.007 ms max 23.698 ms avg 0.034 ms med 0.020 ms std 0.408 C open file cnt 12335 min 0.014 ms max 0.569 ms avg 0.021 ms med 0.016 ms std 0.021 D rd 1st byte cnt 12335 min 0.179 ms max 115.706 ms avg 1.241 ms med 0.298 ms std 4.946 E read rate 27.553 MB/s (data) 10.908 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5508 min 0.039 ms max 1631.347 ms avg 4.066 ms med 0.045 ms std 62.290 G wr 1st byte cnt 5508 min 0.006 ms max 0.109 ms avg 0.007 ms med 0.007 ms std 0.002 H write close cnt 5508 min 0.011 ms max 1.670 ms avg 0.016 ms med 0.016 ms std 0.027 I mkdir cnt 510 min 0.025 ms max 2206.315 ms avg 11.261 ms med 0.033 ms std 131.447 J write rate 642.772 MB/s (data) 8.226 MB/s (open + 1st byte + data + close) A read dir cnt 20 min 0.003 ms max 0.007 ms avg 0.005 ms med 0.005 ms std 0.001 B lstat file cnt 20 min 0.025 ms max 0.097 ms avg 0.038 ms med 0.035 ms std 0.015 C open file cnt 20 min 0.019 ms max 0.086 ms avg 0.027 ms med 0.023 ms std 0.014 D rd 1st byte cnt 20 min 111.321 ms max 2038.889 ms avg 969.540 ms med 913.816 ms std 427.296 E read rate 0.073 MB/s (data) 0.014 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22810 min 0.001 ms max 87.846 ms avg 0.067 ms med 0.004 ms std 0.984 B lstat file cnt 21289 min 0.007 ms max 32.383 ms avg 0.029 ms med 0.024 ms std 0.271 C open file cnt 16726 min 0.014 ms max 0.260 ms avg 0.021 ms med 0.017 ms std 0.011 D rd 1st byte cnt 16726 min 0.172 ms max 100.139 ms avg 0.911 ms med 0.279 ms std 3.826 E read rate 39.811 MB/s (data) 15.255 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16406 min 0.001 ms max 120.100 ms avg 0.087 ms med 0.003 ms std 1.186 B lstat file cnt 15300 min 0.007 ms max 17.413 ms avg 0.031 ms med 0.021 ms std 0.296 C open file cnt 11978 min 0.014 ms max 0.507 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 11978 min 0.178 ms max 112.714 ms avg 1.319 ms med 0.298 ms std 5.120 E read rate 27.362 MB/s (data) 10.526 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4633 min 0.039 ms max 459.624 ms avg 0.513 ms med 0.046 ms std 11.259 G wr 1st byte cnt 4633 min 0.006 ms max 0.487 ms avg 0.008 ms med 0.007 ms std 0.014 H write close cnt 4633 min 0.011 ms max 994.941 ms avg 1.356 ms med 0.016 ms std 32.182 I mkdir cnt 429 min 0.026 ms max 63.974 ms avg 0.202 ms med 0.032 ms std 3.098 J write rate 7.383 MB/s (data) 5.220 MB/s (open + 1st byte + data + close) A read dir cnt 6537 min 0.001 ms max 219.608 ms avg 0.269 ms med 0.004 ms std 4.237 B lstat file cnt 6115 min 0.007 ms max 16.788 ms avg 0.039 ms med 0.024 ms std 0.387 C open file cnt 4848 min 0.014 ms max 13.422 ms avg 0.023 ms med 0.017 ms std 0.194 D rd 1st byte cnt 4848 min 0.179 ms max 568.431 ms avg 3.471 ms med 0.324 ms std 17.458 E read rate 12.051 MB/s (data) 4.418 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22284 min 0.001 ms max 85.694 ms avg 0.060 ms med 0.004 ms std 0.828 B lstat file cnt 20798 min 0.007 ms max 10.903 ms avg 0.027 ms med 0.025 ms std 0.148 C open file cnt 16337 min 0.015 ms max 0.309 ms avg 0.020 ms med 0.018 ms std 0.011 D rd 1st byte cnt 16337 min 0.175 ms max 102.914 ms avg 0.937 ms med 0.282 ms std 3.756 E read rate 38.759 MB/s (data) 15.006 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 15972 min 0.001 ms max 110.360 ms avg 0.086 ms med 0.003 ms std 1.280 B lstat file cnt 14898 min 0.007 ms max 41.207 ms avg 0.036 ms med 0.021 ms std 0.520 C open file cnt 11678 min 0.014 ms max 0.447 ms avg 0.020 ms med 0.016 ms std 0.017 D rd 1st byte cnt 11678 min 0.178 ms max 131.423 ms avg 1.337 ms med 0.298 ms std 5.521 E read rate 26.363 MB/s (data) 10.293 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4767 min 0.040 ms max 438.145 ms avg 0.229 ms med 0.046 ms std 6.852 G wr 1st byte cnt 4767 min 0.006 ms max 0.250 ms avg 0.008 ms med 0.007 ms std 0.008 H write close cnt 4767 min 0.011 ms max 1146.215 ms avg 1.292 ms med 0.016 ms std 32.727 I mkdir cnt 427 min 0.026 ms max 194.873 ms avg 0.521 ms med 0.033 ms std 9.429 J write rate 6.845 MB/s (data) 5.185 MB/s (open + 1st byte + data + close) A read dir cnt 6967 min 0.001 ms max 244.011 ms avg 0.219 ms med 0.004 ms std 4.076 B lstat file cnt 6509 min 0.007 ms max 112.913 ms avg 0.059 ms med 0.023 ms std 1.472 C open file cnt 5132 min 0.014 ms max 1.740 ms avg 0.022 ms med 0.017 ms std 0.039 D rd 1st byte cnt 5132 min 0.180 ms max 594.027 ms avg 3.281 ms med 0.327 ms std 16.092 E read rate 12.257 MB/s (data) 4.621 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 21867 min 0.001 ms max 25.641 ms avg 0.057 ms med 0.004 ms std 0.576 B lstat file cnt 20407 min 0.007 ms max 10.900 ms avg 0.027 ms med 0.024 ms std 0.128 C open file cnt 16028 min 0.014 ms max 0.350 ms avg 0.020 ms med 0.017 ms std 0.011 D rd 1st byte cnt 16028 min 0.174 ms max 99.396 ms avg 0.979 ms med 0.279 ms std 4.073 E read rate 38.390 MB/s (data) 14.615 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 10965 min 0.001 ms max 86.246 ms avg 0.127 ms med 0.004 ms std 1.459 B lstat file cnt 10229 min 0.007 ms max 31.071 ms avg 0.033 ms med 0.024 ms std 0.411 C open file cnt 8018 min 0.014 ms max 0.387 ms avg 0.020 ms med 0.017 ms std 0.013 D rd 1st byte cnt 8018 min 0.176 ms max 122.809 ms avg 1.968 ms med 0.301 ms std 6.788 E read rate 17.524 MB/s (data) 6.988 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4659 min 0.040 ms max 89.121 ms avg 0.148 ms med 0.046 ms std 2.108 G wr 1st byte cnt 4659 min 0.006 ms max 0.142 ms avg 0.007 ms med 0.007 ms std 0.004 H write close cnt 4659 min 0.011 ms max 1539.305 ms avg 2.159 ms med 0.016 ms std 43.649 I mkdir cnt 420 min 0.027 ms max 20.742 ms avg 0.086 ms med 0.034 ms std 1.009 J write rate 7.991 MB/s (data) 5.110 MB/s (open + 1st byte + data + close) A read dir cnt 7416 min 0.001 ms max 137.451 ms avg 0.168 ms med 0.004 ms std 2.454 B lstat file cnt 6918 min 0.007 ms max 80.446 ms avg 0.057 ms med 0.023 ms std 1.220 C open file cnt 5422 min 0.015 ms max 1.635 ms avg 0.021 ms med 0.017 ms std 0.027 D rd 1st byte cnt 5422 min 0.177 ms max 372.848 ms avg 3.077 ms med 0.327 ms std 13.205 E read rate 12.077 MB/s (data) 4.751 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=writeback scheduler=cfq ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22212 min 0.001 ms max 90.648 ms avg 0.066 ms med 0.004 ms std 0.933 B lstat file cnt 20727 min 0.007 ms max 10.862 ms avg 0.027 ms med 0.025 ms std 0.122 C open file cnt 16272 min 0.014 ms max 0.192 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 16272 min 0.176 ms max 112.760 ms avg 0.955 ms med 0.281 ms std 3.948 E read rate 39.452 MB/s (data) 14.855 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16261 min 0.001 ms max 109.858 ms avg 0.086 ms med 0.003 ms std 1.218 B lstat file cnt 15166 min 0.007 ms max 96.904 ms avg 0.040 ms med 0.021 ms std 0.870 C open file cnt 11880 min 0.014 ms max 0.487 ms avg 0.020 ms med 0.016 ms std 0.017 D rd 1st byte cnt 11880 min 0.180 ms max 128.245 ms avg 1.253 ms med 0.296 ms std 4.689 E read rate 25.184 MB/s (data) 10.459 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 4020 min 0.040 ms max 48.824 ms avg 0.100 ms med 0.046 ms std 1.080 G wr 1st byte cnt 4020 min 0.006 ms max 0.576 ms avg 0.007 ms med 0.007 ms std 0.009 H write close cnt 4020 min 0.011 ms max 1989.471 ms avg 1.583 ms med 0.015 ms std 43.098 I mkdir cnt 359 min 0.026 ms max 96.822 ms avg 0.533 ms med 0.033 ms std 6.665 J write rate 5.626 MB/s (data) 4.329 MB/s (open + 1st byte + data + close) A read dir cnt 8044 min 0.001 ms max 133.386 ms avg 0.221 ms med 0.004 ms std 3.642 B lstat file cnt 7509 min 0.007 ms max 48.412 ms avg 0.050 ms med 0.024 ms std 0.761 C open file cnt 5904 min 0.015 ms max 0.676 ms avg 0.022 ms med 0.017 ms std 0.025 D rd 1st byte cnt 5904 min 0.179 ms max 244.044 ms avg 2.654 ms med 0.317 ms std 11.051 E read rate 13.197 MB/s (data) 5.275 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22999 min 0.001 ms max 90.722 ms avg 0.064 ms med 0.004 ms std 0.904 B lstat file cnt 21462 min 0.007 ms max 18.710 ms avg 0.028 ms med 0.024 ms std 0.239 C open file cnt 16852 min 0.014 ms max 0.300 ms avg 0.021 ms med 0.018 ms std 0.011 D rd 1st byte cnt 16852 min 0.173 ms max 100.525 ms avg 0.884 ms med 0.275 ms std 3.377 E read rate 38.711 MB/s (data) 15.368 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16474 min 0.001 ms max 118.595 ms avg 0.103 ms med 0.003 ms std 1.765 B lstat file cnt 15361 min 0.007 ms max 83.165 ms avg 0.043 ms med 0.022 ms std 0.947 C open file cnt 12021 min 0.014 ms max 0.301 ms avg 0.020 ms med 0.016 ms std 0.015 D rd 1st byte cnt 12021 min 0.176 ms max 126.691 ms avg 1.238 ms med 0.295 ms std 4.650 E read rate 26.232 MB/s (data) 10.607 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5954 min 0.040 ms max 2677.783 ms avg 3.939 ms med 0.046 ms std 72.158 G wr 1st byte cnt 5954 min 0.006 ms max 0.179 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 5954 min 0.011 ms max 42.503 ms avg 0.024 ms med 0.016 ms std 0.556 I mkdir cnt 538 min 0.026 ms max 2260.410 ms avg 13.268 ms med 0.033 ms std 151.141 J write rate 633.266 MB/s (data) 9.058 MB/s (open + 1st byte + data + close) A read dir cnt 27 min 0.003 ms max 2314.323 ms avg 132.443 ms med 0.005 ms std 489.667 B lstat file cnt 26 min 0.027 ms max 0.104 ms avg 0.036 ms med 0.032 ms std 0.016 C open file cnt 24 min 0.018 ms max 0.136 ms avg 0.028 ms med 0.023 ms std 0.023 D rd 1st byte cnt 24 min 11.519 ms max 2787.144 ms avg 758.647 ms med 596.955 ms std 709.775 E read rate 0.103 MB/s (data) 0.028 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=0 fs=ext4 disk=areca RAID6 journal=ext data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22689 min 0.001 ms max 85.938 ms avg 0.070 ms med 0.004 ms std 1.039 B lstat file cnt 21180 min 0.007 ms max 35.026 ms avg 0.029 ms med 0.024 ms std 0.286 C open file cnt 16655 min 0.014 ms max 0.200 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 16655 min 0.177 ms max 119.199 ms avg 0.888 ms med 0.279 ms std 3.376 E read rate 38.241 MB/s (data) 15.203 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16238 min 0.001 ms max 88.143 ms avg 0.092 ms med 0.003 ms std 1.329 B lstat file cnt 15143 min 0.007 ms max 22.833 ms avg 0.033 ms med 0.021 ms std 0.391 C open file cnt 11858 min 0.014 ms max 0.485 ms avg 0.021 ms med 0.016 ms std 0.018 D rd 1st byte cnt 11858 min 0.177 ms max 133.624 ms avg 1.257 ms med 0.294 ms std 5.129 E read rate 25.132 MB/s (data) 10.399 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 11236 min 0.038 ms max 3226.908 ms avg 2.194 ms med 0.045 ms std 55.743 G wr 1st byte cnt 11236 min 0.006 ms max 0.583 ms avg 0.007 ms med 0.007 ms std 0.007 H write close cnt 11236 min 0.011 ms max 3.224 ms avg 0.016 ms med 0.016 ms std 0.032 I mkdir cnt 1033 min 0.025 ms max 1759.761 ms avg 3.276 ms med 0.033 ms std 62.106 J write rate 656.763 MB/s (data) 15.943 MB/s (open + 1st byte + data + close) A read dir cnt 48 min 0.002 ms max 705.024 ms avg 15.642 ms med 0.004 ms std 100.705 B lstat file cnt 44 min 0.008 ms max 0.163 ms avg 0.032 ms med 0.027 ms std 0.026 C open file cnt 33 min 0.016 ms max 0.111 ms avg 0.027 ms med 0.022 ms std 0.018 D rd 1st byte cnt 33 min 0.228 ms max 3023.964 ms avg 574.053 ms med 90.292 ms std 783.256 E read rate 0.105 MB/s (data) 0.033 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test relatime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 23698 min 0.001 ms max 99.493 ms avg 0.065 ms med 0.004 ms std 1.067 B lstat file cnt 22117 min 0.007 ms max 20.780 ms avg 0.029 ms med 0.024 ms std 0.273 C open file cnt 17373 min 0.015 ms max 0.258 ms avg 0.021 ms med 0.018 ms std 0.010 D rd 1st byte cnt 17373 min 0.177 ms max 105.171 ms avg 0.888 ms med 0.283 ms std 3.507 E read rate 42.670 MB/s (data) 15.915 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16716 min 0.001 ms max 96.119 ms avg 0.093 ms med 0.003 ms std 1.367 B lstat file cnt 15587 min 0.007 ms max 103.883 ms avg 0.038 ms med 0.021 ms std 0.896 C open file cnt 12196 min 0.014 ms max 0.477 ms avg 0.020 ms med 0.016 ms std 0.018 D rd 1st byte cnt 12196 min 0.176 ms max 125.070 ms avg 1.248 ms med 0.294 ms std 4.736 E read rate 27.072 MB/s (data) 10.745 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 5031 min 0.040 ms max 2705.763 ms avg 4.750 ms med 0.046 ms std 71.544 G wr 1st byte cnt 5031 min 0.006 ms max 1.780 ms avg 0.007 ms med 0.007 ms std 0.025 H write close cnt 5031 min 0.011 ms max 19.295 ms avg 0.020 ms med 0.016 ms std 0.273 I mkdir cnt 447 min 0.026 ms max 3226.452 ms avg 12.958 ms med 0.033 ms std 170.549 J write rate 667.553 MB/s (data) 7.597 MB/s (open + 1st byte + data + close) A read dir cnt 34 min 0.001 ms max 311.539 ms avg 9.167 ms med 0.005 ms std 52.636 B lstat file cnt 33 min 0.012 ms max 0.093 ms avg 0.035 ms med 0.029 ms std 0.018 C open file cnt 29 min 0.020 ms max 0.118 ms avg 0.031 ms med 0.023 ms std 0.024 D rd 1st byte cnt 29 min 0.344 ms max 2174.376 ms avg 834.844 ms med 879.501 ms std 591.632 E read rate 0.095 MB/s (data) 0.019 MB/s (readdir + open + 1st byte + data) Linux 2.6.31.2-test atime barrier=1 fs=ext4 disk=areca RAID6 journal=ext data=writeback scheduler=deadline ************************************************************************************** 1 readers (30s) ---------------------------------------------------------------------- A read dir cnt 22597 min 0.001 ms max 97.359 ms avg 0.076 ms med 0.004 ms std 1.258 B lstat file cnt 21092 min 0.007 ms max 99.652 ms avg 0.032 ms med 0.024 ms std 0.711 C open file cnt 16577 min 0.014 ms max 0.189 ms avg 0.020 ms med 0.017 ms std 0.010 D rd 1st byte cnt 16577 min 0.176 ms max 99.005 ms avg 0.941 ms med 0.280 ms std 3.842 E read rate 41.895 MB/s (data) 15.205 MB/s (readdir + open + 1st byte + data) 3 readers (30s) ---------------------------------------------------------------------- A read dir cnt 16905 min 0.001 ms max 97.696 ms avg 0.094 ms med 0.003 ms std 1.231 B lstat file cnt 15763 min 0.007 ms max 52.897 ms avg 0.035 ms med 0.020 ms std 0.547 C open file cnt 12336 min 0.014 ms max 0.294 ms avg 0.020 ms med 0.016 ms std 0.016 D rd 1st byte cnt 12336 min 0.178 ms max 120.298 ms avg 1.231 ms med 0.294 ms std 4.613 E read rate 27.499 MB/s (data) 10.935 MB/s (readdir + open + 1st byte + data) 3 readers, 3 writers (30s) ---------------------------------------------------------------------- F write open cnt 6012 min 0.039 ms max 2750.740 ms avg 3.939 ms med 0.045 ms std 73.537 G wr 1st byte cnt 6012 min 0.006 ms max 0.196 ms avg 0.007 ms med 0.007 ms std 0.005 H write close cnt 6012 min 0.011 ms max 0.795 ms avg 0.017 ms med 0.016 ms std 0.017 I mkdir cnt 536 min 0.024 ms max 2743.244 ms avg 9.037 ms med 0.033 ms std 128.367 J write rate 641.224 MB/s (data) 9.309 MB/s (open + 1st byte + data + close) A read dir cnt 37 min 0.002 ms max 1054.766 ms avg 76.805 ms med 0.005 ms std 232.198 B lstat file cnt 34 min 0.009 ms max 0.096 ms avg 0.029 ms med 0.029 ms std 0.014 C open file cnt 23 min 0.017 ms max 0.091 ms avg 0.028 ms med 0.023 ms std 0.018 D rd 1st byte cnt 23 min 21.004 ms max 3251.574 ms avg 966.606 ms med 846.649 ms std 722.277 E read rate 0.038 MB/s (data) 0.009 MB/s (readdir + open + 1st byte + data)