Verify score hash error

[bigbrotherwei]

tag: io500-isc25

The picture is too large to upload. I can only describe it in words.

l run io500 test with command below

./io500 config-scc.ini

and got the result

[root@io500 io500]# ./io500 config-scc.ini
IO500 version io500-isc25_v1 (standard)
[RESULT]       ior-easy-write        0.344202 GiB/s : time 37.080 seconds
[RESULT]    mdtest-easy-write       17.665954 kIOPS : time 31.106 seconds
[      ]            timestamp        0.000000 kIOPS : time 0.000 seconds
[RESULT]       ior-hard-write        0.348420 GiB/s : time 36.634 seconds
[RESULT]    mdtest-hard-write       13.562440 kIOPS : time 32.980 seconds
[RESULT]                 find      804.405959 kIOPS : time 1.200 seconds
[RESULT]        ior-easy-read        0.365898 GiB/s : time 34.880 seconds
[RESULT]     mdtest-easy-stat       51.203668 kIOPS : time 11.388 seconds
[RESULT]        ior-hard-read        0.365881 GiB/s : time 34.885 seconds
[RESULT]     mdtest-hard-stat       54.187675 kIOPS : time 9.006 seconds
[RESULT]   mdtest-easy-delete       27.305840 kIOPS : time 20.497 seconds
[RESULT]     mdtest-hard-read        5.079395 kIOPS : time 86.386 seconds
[RESULT]   mdtest-hard-delete       21.783506 kIOPS : time 20.918 seconds
[      ]  ior-rnd4K-easy-read        0.021096 GiB/s : time 30.000 seconds
[SCORE ] Bandwidth 0.355962 GiB/s : IOPS 33.577116 kiops : TOTAL 3.457193

The result files are stored in the directory: ./results/2025.05.06-09.41.49

But when I checked the validity of the scores, the script prompted me to check for errors

[root@io500 io500]# ./io500 config-scc.ini --verify ./results/2025.05.06-09.41.49/result.txt
result file ver = io500-isc25_v1
[run]
config-hash     = E8DBABA8
score-hash      = CF59C2C2

ERROR: Score hash expected: "61C3B386" read: "CF59C2C2"

l also used config-minimal.ini for test and got the same error

[root@io500 io500]# ./io500 config-minimal.ini --verify results//2025.05.06-08.49.01/result.txt
result file ver = io500-isc25_v1
[run]
config-hash     = B6CFE96A
score-hash      = CF547006

I found that there were similar problems before: #39

I want to know if my testing method is wrong or there is something wrong with this tag

[adilger]

The "config-scc.ini" file is used for the Student Cluster Competition at SC/ISC events, and only has a runtime of 30 seconds per phase. A regular IO500 submission has a runtime of 300s per phase.

That said, it might be that the addition of the ior-rnd4K-easy-read phase has broken the checksum verification?

[bigbrotherwei]

The "config-scc.ini" file is used for the Student Cluster Competition at SC/ISC events, and only has a runtime of 30 seconds per phase. A regular IO500 submission has a runtime of 300s per phase.

That said, it might be that the addition of the ior-rnd4K-easy-read phase has broken the checksum verification?

l want to verify whether the test is normal first, so l use "config-scc.ini" to do a simple test.

l added the following configuration in "config-scc.ini" to avoid " ior-rnd4K-easy-read " test

[ior-rnd4K-easy-read]
# The API to be used
API =
# Run this phase
run = FALSE

Unfortunately, l still got the error

[root@io500 io500]# ./io500 config-scc.ini
IO500 version io500-isc25_v1 (standard)
[RESULT]       ior-easy-write        0.348542 GiB/s : time 37.095 seconds
[RESULT]    mdtest-easy-write       18.827731 kIOPS : time 31.075 seconds
[      ]            timestamp        0.000000 kIOPS : time 0.000 seconds
[RESULT]       ior-hard-write        0.345958 GiB/s : time 36.773 seconds
[RESULT]    mdtest-hard-write       13.222658 kIOPS : time 32.578 seconds
[RESULT]                 find      725.266887 kIOPS : time 1.357 seconds
[RESULT]        ior-easy-read        0.407353 GiB/s : time 31.738 seconds
[RESULT]     mdtest-easy-stat       54.197668 kIOPS : time 11.448 seconds
[RESULT]        ior-hard-read        0.367235 GiB/s : time 34.645 seconds
[RESULT]     mdtest-hard-stat       57.083860 kIOPS : time 8.316 seconds
[RESULT]   mdtest-easy-delete       26.887039 kIOPS : time 22.073 seconds
[RESULT]     mdtest-hard-read        5.120061 kIOPS : time 82.548 seconds
[RESULT]   mdtest-hard-delete       25.027021 kIOPS : time 17.692 seconds
ERROR INVALID (src/main.c:439) Resulting score shouldn't be 0.0
[      ]  ior-rnd4K-easy-read        0.000000 GiB/s : time 0.000 seconds [INVALID]
[SCORE ] Bandwidth 0.366478 GiB/s : IOPS 34.319581 kiops : TOTAL 3.546460 [INVALID]

The result files are stored in the directory: ./results/2025.05.07-06.11.22
[root@io500 io500]# ./io500 config-scc.ini --verify ./results/2025.05.07-06.11.22/result.txt
result file ver = io500-isc25_v1
[run]
config-hash     = E8F73280
score-hash      = CF6CCB40

ERROR: Score hash expected: "61FFD79D" read: "CF6CCB40"

[adilger]

I think the "--verify" check is not critical. I would recommend to go ahead submit your actual benchmark results while waiting a response on this ticket. I suspect this is an issue in the code and not related to your benchmark runs, and your results are valid.

You can resubmit your results until the deadline of June 2, in case there is an issue.

[bigbrotherwei]

I think the "--verify" check is not critical. I would recommend to go ahead submit your actual benchmark results while waiting a response on this ticket. I suspect this is an issue in the code and not related to your benchmark runs, and your results are valid.

You can resubmit your results until the deadline of June 2, in case there is an issue.

Thanks for your reply. I'm already conducting my benchmark test.