|
| 1 | +# User Test Checklist |
| 2 | + |
| 3 | +| | | |
| 4 | +| ---------- | ------------ | |
| 5 | +| **Tester** | Brock Wester | |
| 6 | +| **Date** | 9/9/26 | |
| 7 | + |
| 8 | +A basic manual pass through the app before a release or after a significant change. |
| 9 | + |
| 10 | +## Loading a file |
| 11 | + |
| 12 | +- [ ] Loading a sample video from the sample picker works |
| 13 | +- [x] Loading a local video file via the file picker / drag-and-drop works |
| 14 | +- [x] The educational toggle is visible and switching it on/off changes what's shown |
| 15 | + |
| 16 | +## Inspect tab |
| 17 | + |
| 18 | +- [x] The atom/box tree renders for a loaded MP4 |
| 19 | +- [x] Selecting an atom shows its details and jumps to the right spot in the tree |
| 20 | +- [x] Table of contents navigation matches the atom tree |
| 21 | +- [x] Educational explainers appear when the educational toggle is on |
| 22 | + |
| 23 | +## Analysis tab |
| 24 | + |
| 25 | +- [x] The bitrate chart renders and reflects the loaded file |
| 26 | +- [x] Chroma format, codec, and container details are shown correctly |
| 27 | + |
| 28 | +## Compare tab |
| 29 | + |
| 30 | +- [x] Two files can be loaded side-by-side (A/B panel) |
| 31 | +- [x] The quality/size matrix populates correctly |
| 32 | +- [x] The savings panel shows a sensible size/quality comparison |
| 33 | + |
| 34 | +## Seek tab |
| 35 | + |
| 36 | +- [x] Running a seek test against a loaded file produces a report |
| 37 | +- [x] The segment run / timeline reflects the seek results accurately |
| 38 | + |
| 39 | +## Encode tab |
| 40 | + |
| 41 | +- [x] An in-browser encode (ffmpeg) runs to completion on a sample file |
| 42 | + - [x] the progress indicator updates throughout |
| 43 | +- [x] The CLI command preview matches the selected encode settings |
| 44 | +- [x] The encoded output can be downloaded/saved |
| 45 | + |
| 46 | +## Demos page |
| 47 | + |
| 48 | +- [x] Demo videos load and play |
| 49 | +- [x] The demo archive download works |
| 50 | + |
| 51 | +## Cross-cutting |
| 52 | + |
| 53 | +- [x] The app remains usable after loading several files in a row (no memory leak or crash) |
| 54 | +- [x] The app is usable in both light and dark OS/browser theme |
| 55 | +- [x] Basic responsiveness: window resized narrower doesn't break layout or hide controls |
| 56 | +- [ ] Loading the page shows no errors in the browser console |
| 57 | +- [x] Can navigate to all hyperlinks in the bottom-left |
| 58 | + |
| 59 | +## Extra notes |
| 60 | + |
| 61 | +consider some kind of byte range portrayal on mp4 box; caused confusion since user thought it was by 'time' |
| 62 | + |
| 63 | +reduce of hover text on bitrate over time; same for seeking test plot |
| 64 | + |
| 65 | +save icon for export table ; |
| 66 | + |
| 67 | +CRF not defined in tooltip |
| 68 | + |
| 69 | +Intro paragraph to enhance or give context to the reencode parameters ; one, two - word impact per param |
| 70 | + |
| 71 | +Extra note on SLEAP tutorial file Inspect page: |
| 72 | + |
| 73 | +``` |
| 74 | +Note: this file's btrt box gives 651 kbps as both the track's average and its maximum rate, which read literally would mean a constant bitrate. The sample sizes say otherwise: the windows below run from 377 kbps to 1.08 Mbps. Muxers commonly write the computed average into both fields whatever the encoder was doing (ffmpeg does), so that declaration is not evidence of a constant rate on its own, and the sample table is the measurement that settles it. |
| 75 | +``` |
| 76 | + |
| 77 | +changed parameters on reencode page was not obvious user had to click rerun to regenerate |
| 78 | + |
| 79 | +triple check if tooltips are the same on matrix page as reeoncode page |
| 80 | + |
| 81 | +from reencoding page, selected particular non-default matrix settings such as 25% resolution and slow preset; wanted that to then be selected on the matrix page |
| 82 | + |
| 83 | +standardize play button icon for matrix page; caused confusion |
| 84 | + |
| 85 | +full table of text for seeking values in full analysis pdf |
| 86 | + |
| 87 | +include full grid in 'full analysis' |
| 88 | + |
| 89 | +try to embed interactive svg in pdf |
| 90 | + |
| 91 | +"Start here" rename to "Basic Examples" ; add a description of what the browse demos page to explain the narrative purpose ; description of each theme |
| 92 | + |
| 93 | +Replace video reset icon with 'choose another video' |
| 94 | + |
| 95 | +keep 'open in app' button clamped to be more visually obvious; viewer window is for 'selecting scenario' |
| 96 | + |
| 97 | +dev console: |
| 98 | + |
| 99 | +``` |
| 100 | +(from Encoding Helper load from URL): |
| 101 | +=== |
| 102 | +Unchecked runtime.lastError: Could not establish connection. Receiving end does not exist. |
| 103 | +index-B1KALnla.js:298 [encoding-helper] playback stopped: InputDisposedError: Input has been disposed. |
| 104 | + at Object.next (mediabunny-DzughvAZ.js:1:373460) |
| 105 | + at async Qc.getSample (mediabunny-DzughvAZ.js:1:385328) |
| 106 | + at async $c.getCanvas (mediabunny-DzughvAZ.js:1:388427) |
| 107 | + at async Promise.all (index 1) |
| 108 | + at async le (index-B1KALnla.js:298:27111) |
| 109 | + at async he (index-B1KALnla.js:298:27881) |
| 110 | +he @ index-B1KALnla.js:298 |
| 111 | +index-B1KALnla.js:298 [encoding-helper] showSaveFilePicker failed, falling back to download: SecurityError: Failed to execute 'showSaveFilePicker' on 'Window': Must be handling a user gesture to show a file picker. |
| 112 | + at gr (index-B1KALnla.js:298:5443) |
| 113 | + at oc (index-B1KALnla.js:300:35195) |
| 114 | +gr @ index-B1KALnla.js:298 |
| 115 | +ember-open-data.s3.amazonaws.com/blobs/053/1ff/0531ff75-2f61-4588-91e5-db8b8d231a9b?response-content-disposition=attachment%3B%20filename%3D%22sub-01_ses-h264high444_video.mp4%22&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAXKPUZQVWM2URG4F2%2F20260918%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260918T150805Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=host&X-Amz-Signature=3b9fc3e62f5ca952eb72e169e103ec338c0245c700ed95c856e2e68d4e12d548:1 Failed to load resource: the server responded with a status of 403 (Forbidden) |
| 116 | +index-B1KALnla.js:300 [encoding-helper] load failed: Error: mp4box could not parse this file (moov box not found or incomplete) |
| 117 | + at jn (index-B1KALnla.js:298:983) |
| 118 | + at async pl (index-B1KALnla.js:300:56375) |
| 119 | +pl @ index-B1KALnla.js:300 |
| 120 | +``` |
| 121 | + |
| 122 | +consider interactions with EMBER |
| 123 | + |
| 124 | +attempt to create a pre-flight check for load from URL (attempting to load 1 GB files stalled out but that was because it was an AVI from Mang's) |
0 commit comments