Peer Review - Report Results Don't Show Real Results

[KalpShah999]

Artifact Under Review

VnVReport

Team Number for Team Doing the Review

Team 6

The results that are written in the documents aren't showcasing real results, and often aren't encapsulating the full requirements as defined in the VnVPlan. Listed below are the mismatches found from the plan to the report.

test-FR1-MIC-3

• The test plan says you'll test when you have no backup mic with an expected error as the output but that isn't seen in the report as an outcome. Scope of the test wasn't covered, but was deemed to be a pass.

test-FR2-ASR-1, test-FR2-ASR-2

• The test results just iterate over the pass criteria and don't actually give results
• "Achieved greater than 80%" -> just say the number that you achieved, show the result

test-FR3-UI-1

• Plan says it will calculate percentage on successful trials, no percentage is seen in the results section

test-FR4-MAP-1

• Results just say achieved high accuracy, but doesn't compare it to the pass criteria of over 90% as defined in the VnVPlan

test-FR4-MAP-2

• Results say "in the vast majority of cases" instead of the greater than 90% pass criteria as defined in the VnVPlan

[kelvin-u]

#328