Skip to content

Add staged and category-based unit test execution - #1312

Merged
Yaxuan-w merged 3 commits into
mainfrom
classify-unit-test-categories
Aug 3, 2026
Merged

Yaxuan-w merged 3 commits into
mainfrom
classify-unit-test-categories

Conversation

@DanielZ224

Copy link
Copy Markdown
Contributor

Summary

Adds category-based and staged execution for the existing WASM unit-test suite.

This change:

  • Defines unit-test categories using the existing test directory structure.
  • Adds a repeatable --category option for selecting one or more categories.
  • Runs selected categories in a fixed order by default.
  • Stops after the first failing category.
  • Reports completed, failed, and skipped categories.
  • Detects test failures from harness report data instead of relying only on the harness process exit code.
  • Adds unit tests for category ordering, folder expansion, staged stopping, combined execution, and report failure detection.

Categories

  • math
  • filesystem
  • memory
  • process
  • signals
  • networking
  • dynamic-linking

Usage

Run a single category:

python3 scripts/test/test_runner.py \
  --harness wasmtestreport \
  --category filesystem

Run multiple categories progressively:

python3 scripts/test/test_runner.py \
  --harness wasmtestreport \
  --category math \
  --category filesystem

Run selected categories together without staged stopping:

python3 scripts/test/test_runner.py \
  --harness wasmtestreport \
  --category math \
  --category filesystem \
  --no-staged

Validation

python3 -m py_compile \
  scripts/test/test_runner.py \
  scripts/test/test_test_runner.py
cd scripts/test
python3 -m unittest -v test_test_runner.py

Result:

Ran 12 tests
OK

Manual staged validation also confirmed that when the math category reported failures, execution stopped and the filesystem category was reported as skipped.

Closes #1275.

@DanielZ224
DanielZ224 requested a review from Yaxuan-w July 13, 2026 19:33
@Yaxuan-w

Copy link
Copy Markdown
Member

Ci failed due to missing test reports

@DanielZ224

Copy link
Copy Markdown
Contributor Author

Thanks for pointing this out. The staged runner was generating per-category reports but no longer produced the legacy reports/wasm.json expected by CI.

I added a compatibility summary report while preserving the category reports. I also ensured that a failed WASM category only stops subsequent WASM categories and does not prevent the other harnesses from running.

The runner tests now pass: 13 passed.

@github-actions

Copy link
Copy Markdown
Contributor

End-to-End Test Report

Test Preview
grate harness

Grate Test Report

MetricValue
Total15
Success15
Failures0
Compile Failures0
Runtime Failures0
Timeout Failures0
Missing Pair Failures0

Cases

TestStatusError TypeOutput
concurrent-request/geteuid_grate.cSuccess
STDOUT:
[Grate|geteuid] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 3
[Cage | geteuid] PASS: 1000000 calls returned 10
[Grate|geteuid] PASS

STDERR:

concurrent-request/race-test_grate.cSuccess
STDOUT:
pass

STDERR:

concurrent-request/thread_race_grate.cSuccess
STDOUT:
[thread_race] Registering handler for cage 2 in grate 1 with fn ptr addr: 3
[thread_race] PASS: 20 threads x 100000 calls returned 10
[thread_race] PASS

STDERR:

copy-data-between-cages/cp-stncpy_grate.cSuccess
STDOUT:
[cage] pathname addr=0xfffb6ff9
[cage] pathname='random'
[Grate|open] intercepts open call: thiscage=1, arg1cage=2
[Grate|open] copied pathname: random
[cage] fd=10

STDERR:

copy-data-between-cages/cpdata_grate.cSuccess
STDOUT:
[Grate|open] intercepts open call: thiscage=1, arg1cage=2
[Grate|open] copied pathname: random
[cage] fd=10

STDERR:

interposing-calls/fork-with-newret_grate.cSuccess
STDOUT:
[Grate|interpose-fork] Registering fork handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|interpose-fork] Handling function ptr: 3 from cage: 1
[Grate|interpose-fork] In fork_grate 1 handler for cage: 1
[Cage] Forked process with PID: 10
[Grate|interpose-fork] PASS

STDERR:

interposing-calls/interpose-exec_grate.cSuccess
STDOUT:
[Grate|interpose-exec] Registering exec handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|interpose-exec] Handling function ptr: 3 from cage: 1
[Grate|interpose-exec] In exec_grate 1 handler for cage: 1
[Grate|interpose-exec] Handling function ptr: 3 from cage: 1
[Grate|interpose-exec] In exec_grate 1 handler for cage: 1
Exec successful, argv[1]: --execd
[Grate|interpose-exec] PASS

STDERR:

interposing-calls/interpose-exit_grate.cSuccess
STDOUT:
[Grate|interpose-exit] Registering exit handler for cage 2 in grate 1 with fn ptr addr: 3
Exiting...

[Grate|interpose-exit] PASS

STDERR:

interposing-calls/interpose-fork_grate.cSuccess
STDOUT:
[Grate|interpose-fork] Registering fork handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|interpose-fork] Handling function ptr: 3 from cage: 1
[Grate|interpose-fork] In fork_grate 1 handler for cage: 1
[Grate|interpose-fork] PASS

STDERR:

interposing-calls/interpose-mmap_grate.cSuccess
STDOUT:
[Grate|interpose-mmap] Registering mmap handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|interpose-mmap] Handling function ptr: 3 from cage: 1
[Grate|interpose-mmap] In mmap_grate 1 handler for cage: 1
[Grate|interpose-mmap] Handling function ptr: 3 from cage: 1
[Grate|interpose-mmap] In mmap_grate 1 handler for cage: 1
[Grate|interpose-mmap] Handling function ptr: 3 from cage: 1
[Grate|interpose-mmap] In mmap_grate 1 handler for cage: 1
[Grate|interpose-mmap] Handling function ptr: 3 from cage: 1
[Grate|interpose-mmap] In mmap_grate 1 handler for cage: 1
[Grate|interpose-mmap] Handling function ptr: 3 from cage: 1
[Grate|interpose-mmap] In mmap_grate 1 handler for cage: 1
mmap test: PASS
[Grate|interpose-mmap] PASS

STDERR:

interposing-calls/interpose-register_grate.cSuccess
STDOUT:
[Grate|interpose-register] Registering register_handler for cage 2 in grate 1 with fn ptr addr: 4
[cage] registering 107. grateid: 2 cageid: 3
[Grate|interpose-register] Handling function ptr: 4 from cage: 1
[Grate|interpose-register] In register_grate 1 handler for cage: 1
[Grate|geteuid] Registering geteuid handler for cage 1 in grate 1 with fn ptr addr: 3
[Grate|interpose-register] Handling function ptr: 3 from cage: 1
[Grate|interpose-register] In register_grate 1 handler for cage: 1
[Grate|interpose-register] PASS

STDERR:

multi-register_grate.cSuccess
STDOUT:
[Grate|multi-register_grate] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 4
[Grate|multi-register_grate] Registering getuid handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|multi-register_grate] Handling function ptr: 4 from cage: 1
[Grate|multi-register_grate] In multi-register_grate 1 handler for cage: 1
[Grate|multi-register_grate] Handling function ptr: 3 from cage: 1
[Grate|multi-register_grate] In multi-register_grate 1 handler for cage: 1
[Cage | multi-register] PASS: geteuid=10, getuid=20
[Grate|multi-register] PASS

STDERR:

simple-tests/copy-handler-table_grate.cSuccess
STDOUT:
[Grate|copy-handler-table] Registering geteuid handler for cage 2 in grate 1
[Grate|copy-handler-table] geteuid handler invoked for cage 1
[Grate|copy-handler-table] geteuid handler invoked for cage 1
[Cage|copy-handler-table] PASS: child inherited handler, then overwrite changed geteuid to 0
[Cage|copy-handler-table] PASS: parent=123 child_exit=0
[Grate|copy-handler-table] PASS

STDERR:

simple-tests/diff-cage-args_grate.cSuccess
STDOUT:
[Grate|diff-cage-args] Handling function ptr: 3 from cage: 1
[Grate|diff-cage-args] In open_grate 1 handler for cage: 1
Hello world. FD=-1
[Grate|diff-cage-args] Handling function ptr: 4 from cage: 1
Goodbye world! ret=4321 buf=helloworld
[Grate|diff-cage-args] PASS

STDERR:

simple-tests/geteuid_grate.cSuccess
STDOUT:
[Grate|geteuid] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|geteuid] Handling function ptr: 3 from cage: 1
[Grate|geteuid] In geteuid_grate 1 handler for cage: 1
[Cage | geteuid] PASS: geteuid ret = 10
[Grate|geteuid] PASS

STDERR:

static harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases3
Number of Successes3
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Static Tests
fork_simple.cSuccessNone0.287195s3.113575s
Success
thread.cSuccessNone0.040280s3.182014s
Success
tls_test.cSuccessNone0.045142s3.182271s
Success

Fail Tests

Summary

MetricCount
Total Test Cases0
Number of Successes0
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0
wasm-math harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases3
Number of Successes3
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Math Tests
math_link_smoke.cSuccessNone0.050552s0.103817s
Success
math_tests.cSuccessNone0.049804s0.115040s
Success
printf_float.cSuccessNone0.046904s0.109019s
Success

Fail Tests

Summary

MetricCount
Total Test Cases0
Number of Successes0
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0
wasm-filesystem harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases73
Number of Successes73
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
File Tests
chartests.cSuccessNone0.040064s0.121870s
Success
chdir_getcwd.cSuccessNone0.040750s0.097250s
Success
chmod.cSuccessNone0.044114s0.107049s
Success
clock_gettime_highlevel.cSuccessNone0.232097s0.208274s
Success
clock_gettime_simple.cSuccessNone0.036502s0.091252s
Success
cloexec.cSuccessNone0.043179s0.163256s
Success
close.cSuccessNone0.050203s0.118382s
Success
copy_file_range.cSuccessNone0.044336s0.117804s
Success
creat_access.cSuccessNone0.042914s0.099529s
Success
doubleclose.cSuccessNone0.038358s0.088814s
Success
dup.cSuccessNone0.037645s0.097103s
Success
dup2.cSuccessNone0.042330s0.097933s
Success
dup3.cSuccessNone0.040642s0.098352s
Success
dupwrite.cSuccessNone0.042525s0.096693s
Success
etc_conf.cSuccessNone0.039722s0.113066s
Success
faccessat.cSuccessNone0.042348s0.104750s
Success
fchdir.cSuccessNone0.044340s0.108097s
Success
fchmod.cSuccessNone0.043599s0.108623s
Success
fchmodat.cSuccessNone0.040452s0.098217s
Success
fcntl.cSuccessNone0.042262s0.190425s
Success
fcntl_dupfd.cSuccessNone0.039136s0.096213s
Success
fdatasync.cSuccessNone0.042270s0.098195s
Success
filetest.cSuccessNone0.043880s0.097473s
Success
filetest1000.cSuccessNone0.049226s0.105935s
Success
flock.cSuccessNone0.086309s0.138377s
Success
fstat.cSuccessNone0.045516s0.111259s
Success
fstatfs.cSuccessNone0.039088s0.092941s
Success
fsync.cSuccessNone0.548632s0.095404s
Success
ftruncate.cSuccessNone0.045395s0.169584s
Success
getcwd.cSuccessNone0.357457s0.090663s
Success
getcwd_null.cSuccessNone0.042658s0.101278s
Success
getpgid.cSuccessNone0.038349s0.088427s
Success
getrandom.cSuccessNone0.043189s0.106858s
Success
ioctl.cSuccessNone0.045312s0.103487s
Success
link.cSuccessNone0.045328s0.131585s
Success
locale_test.cSuccessNone0.132915s0.251470s
Success
lseek.cSuccessNone0.045181s0.154571s
Success
lstat.cSuccessNone0.067982s0.115443s
Success
mkdir_rmdir.cSuccessNone0.043237s0.104447s
Success
mkfifo_test.cSuccessNone0.046585s0.137651s
Success
mknod.cSuccessNone0.041963s0.106412s
Success
nocancel_io.cSuccessNone0.044875s0.116597s
Success
open.cSuccessNone0.039514s0.092163s
Success
openat.cSuccessNone0.040377s0.149201s
Success
path_conversion_safety.cSuccessNone0.046707s0.114123s
Success
ppoll.cSuccessNone0.046505s0.109312s
Success
pread_pwrite.cSuccessNone0.041572s0.100792s
Success
preadv_pwritev.cSuccessNone0.044683s0.112183s
Success
printf.cSuccessNone0.037063s0.085774s
Success
prlimit64.cSuccessNone0.038025s0.091349s
Success
read.cSuccessNone0.042691s0.106677s
Success
readbytes.cSuccessNone0.040171s0.093396s
Success
readdir_basic.cSuccessNone0.045339s0.124234s
Success
readlink.cSuccessNone0.042566s0.102570s
Success
readlinkat.cSuccessNone0.044683s0.108106s
Success
readv_writev_test.cSuccessNone0.044295s0.107097s
Success
rename.cSuccessNone0.044451s0.104288s
Success
renameat.cSuccessNone0.044926s0.111137s
Success
sc-writev.cSuccessNone0.079962s0.100853s
Success
stat.cSuccessNone0.044747s0.111921s
Success
statfs.cSuccessNone0.041696s0.093739s
Success
symlink.cSuccessNone0.044362s0.122319s
Success
sync_file_range.cSuccessNone0.041494s0.094555s
Success
timespec_time_t_compat.cSuccessNone0.040271s0.094775s
Success
trailing_slash.cSuccessNone0.042090s0.102262s
Success
truncate.cSuccessNone0.045661s0.117275s
Success
unlink.cSuccessNone0.044441s0.126538s
Success
unlinkat.cSuccessNone0.043859s0.112301s
Success
utimensat.cSuccessNone0.042510s0.112536s
Success
write.cSuccessNone0.038858s0.088595s
Success
writeloop.cSuccessNone0.044675s0.099103s
Success
writepartial.cSuccessNone0.043713s0.094180s
Success
writev.cSuccessNone0.043662s0.104609s
Success

Fail Tests

Summary

MetricCount
Total Test Cases0
Number of Successes0
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0
wasm-memory harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases27
Number of Successes27
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Memory Tests
brk.cSuccessNone0.041813s0.095603s
Success
fork_large_memory.cSuccessNone0.066108s0.359527s
Success
malloc.cSuccessNone0.039631s0.088303s
Success
malloc_large.cSuccessNone0.041921s0.089425s
Success
memcpy.cSuccessNone0.039625s0.089535s
Success
memory_error_test.cSuccessNone0.044036s0.113241s
Success
mmap.cSuccessNone0.037684s0.090280s
Success
mmap_address_truncation.cSuccessNone0.039296s0.093008s
Success
mmap_aligned.cSuccessNone0.039398s0.151673s
Success
mmap_complicated.cSuccessNone0.042421s0.114880s
Success
mmap_file.cSuccessNone0.043187s0.112746s
Success
mmap_shared.cSuccessNone0.042763s0.112521s
Success
mmaptest.cSuccessNone0.039994s0.093291s
Success
mprotect.cSuccessNone0.038705s0.094512s
Success
mprotect_boundary.cSuccessNone0.039017s0.097423s
Success
mprotect_end_region.cSuccessNone0.038719s0.096566s
Success
mprotect_middle_region.cSuccessNone0.038459s0.096265s
Success
mprotect_multiple_times.cSuccessNone0.038623s0.093642s
Success
mprotect_same_value.cSuccessNone0.037990s0.093280s
Success
mprotect_spanning_regions.cSuccessNone0.039885s0.108943s
Success
munmap_adjacent_shm.cSuccessNone0.041464s0.106638s
Success
sbrk.cSuccessNone0.039319s0.092038s
Success
segfault.cSuccessNone0.043578s0.123821s
Success
shm.cSuccessNone0.042784s0.118136s
Success
shmtest.cSuccessNone0.038674s0.094616s
Success
thread_malloc_sequential.cSuccessNone0.045717s0.147594s
Success
vtable.cSuccessNone0.046370s0.103462s
Success

Fail Tests

Summary

MetricCount
Total Test Cases4
Number of Successes4
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Memory Tests
invalid_access_direct.cSuccessNone0.091667s0.098902s
Success
invalid_access_fork.cSuccessNone0.103119s0.127459s
Success
mmap-negative1.cSuccessNone0.129785s0.094311s
Success
mmap-negative2.cSuccessNone0.104346s0.112838s
Success
wasm-process harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases56
Number of Successes56
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Process Tests
barrier_test.cSuccessNone0.042367s0.122732s
Success
chain_thread.cSuccessNone1.044799s1.150176s
Success
ctor_syscall_test.cSuccessNone0.037115s0.088603s
Success
cxa_atexit_test.cSuccessNone0.046406s0.093830s
Success
exec_non_utf8.cSuccessNone0.042873s0.097502s
Success
execve_shebang.cSuccessNone0.044182s0.117612s
Success
exit.cSuccessNone0.042115s0.091682s
Success
exit_failure.cSuccessNone0.042624s0.110503s
Success
exit_group_thread.cSuccessNone0.044807s0.126139s
Success
exit_status_first_wins.cSuccessNone0.045722s0.127681s
Success
flockfile_test.cSuccessNone0.098087s0.148571s
Success
fork2malloc.cSuccessNone0.044129s0.122225s
Success
fork_select.cSuccessNone0.043648s0.120030s
Success
fork_simple.cSuccessNone0.042336s0.109146s
Success
fork_syscall.cSuccessNone0.046732s0.531641s
Success
fork_tls_ctype.cSuccessNone0.126752s0.129821s
Success
forkandopen.cSuccessNone0.044905s0.121990s
Success
forkdup.cSuccessNone0.045054s0.118597s
Success
forkexecuid.cSuccessNone0.042678s0.128283s
Success
forkexecv-arg.cSuccessNone0.041900s0.121492s
Success
forkexecv.cSuccessNone0.056012s0.177050s
Success
forkfiles.cSuccessNone0.045045s0.117346s
Success
forkmalloc.cSuccessNone0.043568s0.110288s
Success
forknodup.cSuccessNone0.044174s0.123492s
Success
function-ptr.cSuccessNone0.040578s0.093619s
Success
getegid_syscall.cSuccessNone0.044044s0.386261s
Success
getgid_syscall.cSuccessNone0.044722s0.416333s
Success
getpid.cSuccessNone0.039335s0.090364s
Success
getpid_syscall.cSuccessNone0.049410s0.419641s
Success
getppid.cSuccessNone0.043593s0.170425s
Success
getppid_syscall.cSuccessNone0.045899s0.372412s
Success
getuid.cSuccessNone0.048338s0.202861s
Success
getuid_syscall.cSuccessNone0.043151s0.197965s
Success
hello-arg.cSuccessNone0.040367s0.100419s
Success
hello.cSuccessNone0.036807s0.121633s
Success
longjmp.cSuccessNone0.038280s0.095460s
Success
mutex.cSuccessNone2.045977s2.115315s
Success
printf_deadlock_smoke.cSuccessNone0.051133s0.157572s
Success
printf_thread_test.cSuccessNone0.043413s0.120700s
Success
sem_forks.cSuccessNone0.044829s0.149434s
Success
setjmp_edge.cSuccessNone0.039413s0.149924s
Success
setsid.cSuccessNone0.039070s0.089315s
Success
template.cSuccessNone0.043319s0.150915s
Success
test_crossmodule_longjmp.cSuccessNone0.044495s0.123166s
Success
test_exec_nofork.cSuccessNone0.043135s0.112644s
Success
test_unlink_open_file.cSuccessNone0.039938s0.095413s
Success
thread-guard.cSuccessNone0.042041s0.107846s
Success
thread-test.cSuccessNone0.040301s0.107275s
Success
thread.cSuccessNone0.042569s0.103829s
Success
thread_cageid_race.cSuccessNone0.040169s0.234956s
Success
tls_test.cSuccessNone0.042739s0.132200s
Success
uname.cSuccessNone0.048491s0.091052s
Success
wait.cSuccessNone0.041407s0.124114s
Success
waitpid_anychild.cSuccessNone0.043435s0.113982s
Success
waitpid_syscall.cSuccessNone1.059733s1.247407s
Success
waitpid_wnohang.cSuccessNone0.044210s0.131887s
Success

Fail Tests

Summary

MetricCount
Total Test Cases0
Number of Successes0
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0
wasm-signals harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases24
Number of Successes24
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Signal Tests
alarm.cSuccessNone7.043068s7.126386s
Success
eintr_fork_signal.cSuccessNone1.044424s1.126274s
Success
kill.cSuccessNone1.042947s1.113566s
Success
pause_test.cSuccessNone1.043948s1.120587s
Success
setitimer.cSuccessNone7.042805s7.131252s
Success
sigalrm.cSuccessNone2.043124s2.115525s
Success
sigaltstack.cSuccessNone0.044111s0.105562s
Success
sigchld.cSuccessNone1.044365s1.114888s
Success
signal-fork.cSuccessNone4.044770s4.137671s
Success
signal-simple.cSuccessNone0.043966s0.101144s
Success
signal_SIGCHLD.cSuccessNone0.048274s0.127003s
Success
signal_fork.cSuccessNone0.041493s0.117225s
Success
signal_int_ignored.cSuccessNone2.044482s2.125901s
Success
signal_kill_cleanup.cSuccessNone1.047920s1.109433s
Success
signal_procmask.cSuccessNone0.039488s0.098535s
Success
signal_read_interrupt.cSuccessNone0.545995s0.616869s
Success
signal_recursive.cSuccessNone0.039705s0.103877s
Success
signal_sa_mask.cSuccessNone0.040585s0.097934s
Success
signal_select_interrupt.cSuccessNone0.547032s0.628802s
Success
signal_write_interrupt.cSuccessNone1.044897s1.123283s
Success
sigpipe.cSuccessNone1.045016s1.121266s
Success
sigprocmask.cSuccessNone1.043925s1.105614s
Success
sigsuspend_test.cSuccessNone1.043812s1.119577s
Success
test_sigsetjmp.cSuccessNone0.043718s0.122057s
Success

Fail Tests

Summary

MetricCount
Total Test Cases1
Number of Successes1
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Signal Tests
signal_resethand.cSuccessNone1.044179s1.111766s
Success
wasm-networking harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases44
Number of Successes44
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Networking Tests
accept4.cSuccessNone0.046715s0.112299s
Success
dns_resolve_test.cSuccessNone0.042369s0.100479s
Success
dnstest.cSuccessNone0.043403s0.099348s
Success
epoll_badfd.cSuccessNone0.081942s0.093220s
Success
epoll_edge_triggered.cSuccessNone0.197749s0.334719s
Success
epollcreate1.cSuccessNone0.044266s0.107571s
Success
error_handling_net.cSuccessNone0.049295s0.157915s
Success
getaddrinfo_test.cSuccessNone0.045280s0.129002s
Success
getaddrinfo_unspec.cSuccessNone0.054498s0.194400s
Success
gethostname.cSuccessNone0.038949s0.091214s
Success
getifaddrs.cSuccessNone0.043905s0.101582s
Success
getsockname.cSuccessNone0.044829s0.103937s
Success
getsockopt.cSuccessNone0.045774s0.131145s
Success
ipv6_basic.cSuccessNone0.046692s0.128347s
Success
makepipe.cSuccessNone0.038151s0.115863s
Success
nonblocking_eagain.cSuccessNone0.046023s0.134257s
Success
pipe.cSuccessNone0.044374s0.109767s
Success
pipe2.cSuccessNone0.044438s0.100411s
Success
pipeinput.cSuccessNone0.045576s0.126704s
Success
pipeinput2.cSuccessNone0.045149s0.129430s
Success
pipeonestring.cSuccessNone0.045371s0.127737s
Success
pipepong.cSuccessNone0.044481s0.129790s
Success
pipewrite.cSuccessNone0.040741s0.098733s
Success
poll.cSuccessNone0.043459s0.096401s
Success
recvfrom-sendto.cSuccessNone0.044677s0.108883s
Success
sendmsg_recvmsg_test.cSuccessNone0.044005s0.108519s
Success
serverclient.cSuccessNone0.043439s0.110886s
Success
shutdown.cSuccessNone0.044555s0.111712s
Success
shutdown_fork.cSuccessNone0.044382s0.117775s
Success
simple-select.cSuccessNone0.044713s0.127006s
Success
simple_epoll.cSuccessNone0.043957s0.104144s
Success
socket.cSuccessNone0.042191s0.098425s
Success
socket_cloexec.cSuccessNone0.042901s0.097832s
Success
socket_options_advanced.cSuccessNone0.051912s0.152895s
Success
socketepoll.cSuccessNone0.043758s0.109535s
Success
socketpair.cSuccessNone0.044094s0.115587s
Success
socketselect.cSuccessNone0.043442s0.102563s
Success
udp_send_recv.cSuccessNone0.148699s0.244118s
Success
uds-getsockname.cSuccessNone0.043757s0.097917s
Success
uds-nb-select.cSuccessNone2.049984s2.155436s
Success
uds-serverclient.cSuccessNone0.046662s0.132415s
Success
uds-socketselect.cSuccessNone0.044258s0.106835s
Success
uds_listen_poll.cSuccessNone1.222747s1.142568s
Success
writev_socket.cSuccessNone0.045708s0.130686s
Success

Fail Tests

Summary

MetricCount
Total Test Cases0
Number of Successes0
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0
wasm-dynamic-linking harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases7
Number of Successes7
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Dylink Tests
basic.cSuccessNone0.039966s0.102463s
Success
dlopen_fork.cSuccessNone0.041539s0.114967s
Success
dlopen_thread.cSuccessNone0.042235s0.116259s
Success
double_fork_dlopen.cSuccessNone0.043291s0.151581s
Success
fork_dlopen.cSuccessNone0.041755s0.116463s
Success
longjmp_dlopen.cSuccessNone0.041302s0.112420s
Success
rdynamic_main.cSuccessNone0.041695s0.115408s
Success

Fail Tests

Summary

MetricCount
Total Test Cases1
Number of Successes1
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Dylink Tests
dlerror.cSuccessNone0.038664s0.091766s
Success

@github-actions

Copy link
Copy Markdown
Contributor

End-to-End Test Report

Test Preview
grate harness

Grate Test Report

MetricValue
Total15
Success15
Failures0
Compile Failures0
Runtime Failures0
Timeout Failures0
Missing Pair Failures0

Cases

TestStatusError TypeOutput
concurrent-request/geteuid_grate.cSuccess
STDOUT:
[Grate|geteuid] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 3
[Cage | geteuid] PASS: 1000000 calls returned 10
[Grate|geteuid] PASS

STDERR:

concurrent-request/race-test_grate.cSuccess
STDOUT:
pass

STDERR:

concurrent-request/thread_race_grate.cSuccess
STDOUT:
[thread_race] Registering handler for cage 2 in grate 1 with fn ptr addr: 3
[thread_race] PASS: 20 threads x 100000 calls returned 10
[thread_race] PASS

STDERR:

copy-data-between-cages/cp-stncpy_grate.cSuccess
STDOUT:
[cage] pathname addr=0xfffb6ff9
[cage] pathname='random'
[Grate|open] intercepts open call: thiscage=1, arg1cage=2
[Grate|open] copied pathname: random
[cage] fd=10

STDERR:

copy-data-between-cages/cpdata_grate.cSuccess
STDOUT:
[Grate|open] intercepts open call: thiscage=1, arg1cage=2
[Grate|open] copied pathname: random
[cage] fd=10

STDERR:

interposing-calls/fork-with-newret_grate.cSuccess
STDOUT:
[Grate|interpose-fork] Registering fork handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|interpose-fork] Handling function ptr: 3 from cage: 1
[Grate|interpose-fork] In fork_grate 1 handler for cage: 1
[Cage] Forked process with PID: 10
[Grate|interpose-fork] PASS

STDERR:

interposing-calls/interpose-exec_grate.cSuccess
STDOUT:
[Grate|interpose-exec] Registering exec handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|interpose-exec] Handling function ptr: 3 from cage: 1
[Grate|interpose-exec] In exec_grate 1 handler for cage: 1
[Grate|interpose-exec] Handling function ptr: 3 from cage: 1
[Grate|interpose-exec] In exec_grate 1 handler for cage: 1
Exec successful, argv[1]: --execd
[Grate|interpose-exec] PASS

STDERR:

interposing-calls/interpose-exit_grate.cSuccess
STDOUT:
[Grate|interpose-exit] Registering exit handler for cage 2 in grate 1 with fn ptr addr: 3
Exiting...

[Grate|interpose-exit] PASS

STDERR:

interposing-calls/interpose-fork_grate.cSuccess
STDOUT:
[Grate|interpose-fork] Registering fork handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|interpose-fork] Handling function ptr: 3 from cage: 1
[Grate|interpose-fork] In fork_grate 1 handler for cage: 1
[Grate|interpose-fork] PASS

STDERR:

interposing-calls/interpose-mmap_grate.cSuccess
STDOUT:
[Grate|interpose-mmap] Registering mmap handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|interpose-mmap] Handling function ptr: 3 from cage: 1
[Grate|interpose-mmap] In mmap_grate 1 handler for cage: 1
[Grate|interpose-mmap] Handling function ptr: 3 from cage: 1
[Grate|interpose-mmap] In mmap_grate 1 handler for cage: 1
[Grate|interpose-mmap] Handling function ptr: 3 from cage: 1
[Grate|interpose-mmap] In mmap_grate 1 handler for cage: 1
[Grate|interpose-mmap] Handling function ptr: 3 from cage: 1
[Grate|interpose-mmap] In mmap_grate 1 handler for cage: 1
[Grate|interpose-mmap] Handling function ptr: 3 from cage: 1
[Grate|interpose-mmap] In mmap_grate 1 handler for cage: 1
mmap test: PASS
[Grate|interpose-mmap] PASS

STDERR:

interposing-calls/interpose-register_grate.cSuccess
STDOUT:
[Grate|interpose-register] Registering register_handler for cage 2 in grate 1 with fn ptr addr: 4
[cage] registering 107. grateid: 2 cageid: 3
[Grate|interpose-register] Handling function ptr: 4 from cage: 1
[Grate|interpose-register] In register_grate 1 handler for cage: 1
[Grate|geteuid] Registering geteuid handler for cage 1 in grate 1 with fn ptr addr: 3
[Grate|interpose-register] Handling function ptr: 3 from cage: 1
[Grate|interpose-register] In register_grate 1 handler for cage: 1
[Grate|interpose-register] PASS

STDERR:

multi-register_grate.cSuccess
STDOUT:
[Grate|multi-register_grate] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 4
[Grate|multi-register_grate] Registering getuid handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|multi-register_grate] Handling function ptr: 4 from cage: 1
[Grate|multi-register_grate] In multi-register_grate 1 handler for cage: 1
[Grate|multi-register_grate] Handling function ptr: 3 from cage: 1
[Grate|multi-register_grate] In multi-register_grate 1 handler for cage: 1
[Cage | multi-register] PASS: geteuid=10, getuid=20
[Grate|multi-register] PASS

STDERR:

simple-tests/copy-handler-table_grate.cSuccess
STDOUT:
[Grate|copy-handler-table] Registering geteuid handler for cage 2 in grate 1
[Grate|copy-handler-table] geteuid handler invoked for cage 1
[Grate|copy-handler-table] geteuid handler invoked for cage 1
[Cage|copy-handler-table] PASS: child inherited handler, then overwrite changed geteuid to 0
[Cage|copy-handler-table] PASS: parent=123 child_exit=0
[Grate|copy-handler-table] PASS

STDERR:

simple-tests/diff-cage-args_grate.cSuccess
STDOUT:
[Grate|diff-cage-args] Handling function ptr: 3 from cage: 1
[Grate|diff-cage-args] In open_grate 1 handler for cage: 1
Hello world. FD=-1
[Grate|diff-cage-args] Handling function ptr: 4 from cage: 1
Goodbye world! ret=4321 buf=helloworld
[Grate|diff-cage-args] PASS

STDERR:

simple-tests/geteuid_grate.cSuccess
STDOUT:
[Grate|geteuid] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 3
[Grate|geteuid] Handling function ptr: 3 from cage: 1
[Grate|geteuid] In geteuid_grate 1 handler for cage: 1
[Cage | geteuid] PASS: geteuid ret = 10
[Grate|geteuid] PASS

STDERR:

static harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases3
Number of Successes3
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Static Tests
fork_simple.cSuccessNone0.059053s4.127869s
Success
thread.cSuccessNone0.049413s4.245021s
Success
tls_test.cSuccessNone0.056804s4.220168s
Success

Fail Tests

Summary

MetricCount
Total Test Cases0
Number of Successes0
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0
wasm-math harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases3
Number of Successes3
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Math Tests
math_link_smoke.cSuccessNone0.058642s0.112040s
Success
math_tests.cSuccessNone0.059014s0.143511s
Success
printf_float.cSuccessNone0.059120s0.139335s
Success

Fail Tests

Summary

MetricCount
Total Test Cases0
Number of Successes0
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0
wasm-filesystem harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases74
Number of Successes74
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
File Tests
chartests.cSuccessNone0.051204s0.158996s
Success
chdir_getcwd.cSuccessNone0.051205s0.125357s
Success
chmod.cSuccessNone0.056924s0.134295s
Success
clock_gettime_highlevel.cSuccessNone0.122343s0.170463s
Success
clock_gettime_simple.cSuccessNone0.042969s0.110958s
Success
cloexec.cSuccessNone0.054782s0.148390s
Success
close.cSuccessNone0.061880s0.148849s
Success
copy_file_range.cSuccessNone0.054408s0.147542s
Success
creat_access.cSuccessNone0.054917s0.123524s
Success
cross_cage_fd_bruteforce.cSuccessNone0.054779s0.193681s
Success
doubleclose.cSuccessNone0.045985s0.107492s
Success
dup.cSuccessNone0.045771s0.122327s
Success
dup2.cSuccessNone0.053513s0.127315s
Success
dup3.cSuccessNone0.050393s0.124889s
Success
dupwrite.cSuccessNone0.053656s0.123465s
Success
etc_conf.cSuccessNone0.049302s0.124405s
Success
faccessat.cSuccessNone0.049660s0.127410s
Success
fchdir.cSuccessNone0.056819s0.136425s
Success
fchmod.cSuccessNone0.055615s0.138486s
Success
fchmodat.cSuccessNone0.049194s0.127796s
Success
fcntl.cSuccessNone0.052952s0.138724s
Success
fcntl_dupfd.cSuccessNone0.046460s0.121728s
Success
fdatasync.cSuccessNone0.053202s0.118932s
Success
filetest.cSuccessNone0.052680s0.120267s
Success
filetest1000.cSuccessNone0.060899s0.140021s
Success
flock.cSuccessNone0.068357s0.179524s
Success
fstat.cSuccessNone0.054856s0.139640s
Success
fstatfs.cSuccessNone0.048096s0.117766s
Success
fsync.cSuccessNone0.051645s0.120971s
Success
ftruncate.cSuccessNone0.059793s0.216964s
Success
getcwd.cSuccessNone0.049652s0.113340s
Success
getcwd_null.cSuccessNone0.054795s0.128689s
Success
getpgid.cSuccessNone0.046850s0.109339s
Success
getrandom.cSuccessNone0.053391s0.135022s
Success
ioctl.cSuccessNone0.058160s0.133268s
Success
link.cSuccessNone0.057002s0.164246s
Success
locale_test.cSuccessNone0.065770s0.324366s
Success
lseek.cSuccessNone0.059593s0.205936s
Success
lstat.cSuccessNone0.057534s0.145852s
Success
mkdir_rmdir.cSuccessNone0.055210s0.125753s
Success
mkfifo_test.cSuccessNone0.061576s0.183696s
Success
mknod.cSuccessNone0.053042s0.139430s
Success
nocancel_io.cSuccessNone0.056227s0.146773s
Success
open.cSuccessNone0.046542s0.114284s
Success
openat.cSuccessNone0.049124s0.121348s
Success
path_conversion_safety.cSuccessNone0.059094s0.143832s
Success
ppoll.cSuccessNone0.059073s0.136788s
Success
pread_pwrite.cSuccessNone0.050646s0.126355s
Success
preadv_pwritev.cSuccessNone0.056268s0.141547s
Success
printf.cSuccessNone0.044824s0.109823s
Success
prlimit64.cSuccessNone0.046634s0.113029s
Success
read.cSuccessNone0.057617s0.136040s
Success
readbytes.cSuccessNone0.049860s0.120518s
Success
readdir_basic.cSuccessNone0.057566s0.159755s
Success
readlink.cSuccessNone0.054141s0.134136s
Success
readlinkat.cSuccessNone0.056142s0.136525s
Success
readv_writev_test.cSuccessNone0.057229s0.137070s
Success
rename.cSuccessNone0.056327s0.127547s
Success
renameat.cSuccessNone0.060213s0.143706s
Success
sc-writev.cSuccessNone0.053429s0.126222s
Success
stat.cSuccessNone0.054864s0.142230s
Success
statfs.cSuccessNone0.047335s0.111763s
Success
symlink.cSuccessNone0.056946s0.162211s
Success
sync_file_range.cSuccessNone0.052573s0.120121s
Success
timespec_time_t_compat.cSuccessNone0.054374s0.117535s
Success
trailing_slash.cSuccessNone0.052190s0.128312s
Success
truncate.cSuccessNone0.055396s0.146553s
Success
unlink.cSuccessNone0.055883s0.159103s
Success
unlinkat.cSuccessNone0.055836s0.144188s
Success
utimensat.cSuccessNone0.054671s0.141822s
Success
write.cSuccessNone0.047878s0.111121s
Success
writeloop.cSuccessNone0.056618s0.128112s
Success
writepartial.cSuccessNone0.055654s0.121980s
Success
writev.cSuccessNone0.056045s0.135393s
Success

Fail Tests

Summary

MetricCount
Total Test Cases0
Number of Successes0
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0
wasm-memory harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases27
Number of Successes27
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Memory Tests
brk.cSuccessNone0.052224s0.129464s
Success
fork_large_memory.cSuccessNone0.087344s0.483711s
Success
malloc.cSuccessNone0.066846s0.116256s
Success
malloc_large.cSuccessNone0.052942s0.110592s
Success
memcpy.cSuccessNone0.062131s0.276241s
Success
memory_error_test.cSuccessNone0.055724s0.149996s
Success
mmap.cSuccessNone0.045582s0.112979s
Success
mmap_address_truncation.cSuccessNone0.049440s0.115349s
Success
mmap_aligned.cSuccessNone0.057611s0.136883s
Success
mmap_complicated.cSuccessNone0.068528s0.259780s
Success
mmap_file.cSuccessNone0.053412s0.124293s
Success
mmap_shared.cSuccessNone0.058294s0.146298s
Success
mmaptest.cSuccessNone0.047656s0.118326s
Success
mprotect.cSuccessNone0.051585s0.117878s
Success
mprotect_boundary.cSuccessNone0.079679s0.220181s
Success
mprotect_end_region.cSuccessNone0.047819s0.135661s
Success
mprotect_middle_region.cSuccessNone0.051745s0.117784s
Success
mprotect_multiple_times.cSuccessNone0.082129s0.189415s
Success
mprotect_same_value.cSuccessNone0.047692s0.120918s
Success
mprotect_spanning_regions.cSuccessNone0.053532s0.140500s
Success
munmap_adjacent_shm.cSuccessNone0.050940s0.132952s
Success
sbrk.cSuccessNone0.049360s0.111236s
Success
segfault.cSuccessNone0.056535s0.173030s
Success
shm.cSuccessNone0.084490s0.317363s
Success
shmtest.cSuccessNone0.050509s0.129216s
Success
thread_malloc_sequential.cSuccessNone0.084712s0.334012s
Success
vtable.cSuccessNone0.059849s0.144252s
Success

Fail Tests

Summary

MetricCount
Total Test Cases4
Number of Successes4
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Memory Tests
invalid_access_direct.cSuccessNone0.116464s0.134261s
Success
invalid_access_fork.cSuccessNone0.157124s0.153319s
Success
mmap-negative1.cSuccessNone0.171412s0.254940s
Success
mmap-negative2.cSuccessNone0.159341s0.215617s
Success
wasm-process harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases57
Number of Successes57
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Process Tests
barrier_test.cSuccessNone0.053573s0.153376s
Success
chain_thread.cSuccessNone1.054254s1.152638s
Success
ctor_syscall_test.cSuccessNone0.044577s0.113337s
Success
cxa_atexit_test.cSuccessNone0.055531s0.127917s
Success
exec_non_utf8.cSuccessNone0.054557s0.126433s
Success
execve_shebang.cSuccessNone0.053377s0.126830s
Success
exit.cSuccessNone0.055019s0.156308s
Success
exit_failure.cSuccessNone0.055146s0.147501s
Success
exit_group_thread.cSuccessNone0.054559s0.169369s
Success
exit_status_first_wins.cSuccessNone0.057797s0.167707s
Success
flockfile_test.cSuccessNone0.055821s0.161483s
Success
fork2malloc.cSuccessNone0.056456s0.149760s
Success
fork_select.cSuccessNone0.052228s0.157722s
Success
fork_simple.cSuccessNone0.053753s0.145228s
Success
fork_syscall.cSuccessNone0.058833s0.665584s
Success
fork_tls_ctype.cSuccessNone0.057123s0.173456s
Success
forkandopen.cSuccessNone0.057659s0.159134s
Success
forkdup.cSuccessNone0.056777s0.157660s
Success
forkexecuid.cSuccessNone0.051808s0.166755s
Success
forkexecv-arg.cSuccessNone0.052301s0.162236s
Success
forkexecv.cSuccessNone0.053013s0.183082s
Success
forkfiles.cSuccessNone0.065159s0.185254s
Success
forkmalloc.cSuccessNone0.056147s0.142378s
Success
forknodup.cSuccessNone0.055210s0.159450s
Success
function-ptr.cSuccessNone0.050678s0.116392s
Success
getegid_syscall.cSuccessNone0.054703s0.478732s
Success
getgid_syscall.cSuccessNone0.055209s0.513470s
Success
getpid.cSuccessNone0.046790s0.113137s
Success
getpid_syscall.cSuccessNone0.060389s0.576576s
Success
getppid.cSuccessNone0.055914s0.146881s
Success
getppid_syscall.cSuccessNone0.060603s0.425099s
Success
getuid.cSuccessNone0.055884s0.126336s
Success
getuid_syscall.cSuccessNone0.052940s0.260064s
Success
hello-arg.cSuccessNone0.044395s0.120181s
Success
hello.cSuccessNone0.044054s0.107264s
Success
longjmp.cSuccessNone0.044842s0.122284s
Success
mutex.cSuccessNone2.062873s2.159410s
Success
printf_deadlock_smoke.cSuccessNone0.064270s0.186547s
Success
printf_thread_test.cSuccessNone0.052356s0.159448s
Success
sem_forks.cSuccessNone0.055921s0.190979s
Success
sem_slow_path.cSuccessNone1.057696s1.157767s
Success
setjmp_edge.cSuccessNone0.050848s0.218091s
Success
setsid.cSuccessNone0.047495s0.113926s
Success
template.cSuccessNone0.053642s0.201208s
Success
test_crossmodule_longjmp.cSuccessNone0.055125s0.159809s
Success
test_exec_nofork.cSuccessNone0.053396s0.145292s
Success
test_unlink_open_file.cSuccessNone0.049354s0.113553s
Success
thread-guard.cSuccessNone0.052700s0.138061s
Success
thread-test.cSuccessNone0.050747s0.127635s
Success
thread.cSuccessNone0.049175s0.127980s
Success
thread_cageid_race.cSuccessNone0.049738s0.304221s
Success
tls_test.cSuccessNone0.052107s0.169015s
Success
uname.cSuccessNone0.047898s0.111784s
Success
wait.cSuccessNone0.049918s0.165601s
Success
waitpid_anychild.cSuccessNone0.055187s0.147935s
Success
waitpid_syscall.cSuccessNone1.054374s1.246218s
Success
waitpid_wnohang.cSuccessNone0.055626s0.152723s
Success

Fail Tests

Summary

MetricCount
Total Test Cases0
Number of Successes0
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0
wasm-signals harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases24
Number of Successes24
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Signal Tests
alarm.cSuccessNone7.052411s7.158602s
Success
eintr_fork_signal.cSuccessNone1.057366s1.159776s
Success
kill.cSuccessNone1.052919s1.148580s
Success
pause_test.cSuccessNone1.057637s1.156255s
Success
setitimer.cSuccessNone7.056497s7.162495s
Success
sigalrm.cSuccessNone2.053913s2.140721s
Success
sigaltstack.cSuccessNone0.057793s0.144197s
Success
sigchld.cSuccessNone1.058494s1.149639s
Success
signal-fork.cSuccessNone4.055670s4.140191s
Success
signal-simple.cSuccessNone0.054150s0.126793s
Success
signal_SIGCHLD.cSuccessNone0.051906s0.154559s
Success
signal_fork.cSuccessNone0.049904s0.154013s
Success
signal_int_ignored.cSuccessNone2.053838s2.146956s
Success
signal_kill_cleanup.cSuccessNone1.052071s1.138080s
Success
signal_procmask.cSuccessNone0.047407s0.122719s
Success
signal_read_interrupt.cSuccessNone0.558187s0.650549s
Success
signal_recursive.cSuccessNone0.049775s0.137357s
Success
signal_sa_mask.cSuccessNone0.047743s0.123747s
Success
signal_select_interrupt.cSuccessNone0.557891s0.651374s
Success
signal_write_interrupt.cSuccessNone1.057065s1.144634s
Success
sigpipe.cSuccessNone1.056017s1.157651s
Success
sigprocmask.cSuccessNone1.056218s1.129224s
Success
sigsuspend_test.cSuccessNone1.051339s1.152561s
Success
test_sigsetjmp.cSuccessNone0.054201s0.160037s
Success

Fail Tests

Summary

MetricCount
Total Test Cases1
Number of Successes1
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Signal Tests
signal_resethand.cSuccessNone1.052832s1.145232s
Success
wasm-networking harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases44
Number of Successes44
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Networking Tests
accept4.cSuccessNone0.058770s0.148379s
Success
dns_resolve_test.cSuccessNone0.052713s0.129837s
Success
dnstest.cSuccessNone0.054220s0.124861s
Success
epoll_badfd.cSuccessNone0.050003s0.112486s
Success
epoll_edge_triggered.cSuccessNone0.211841s0.389915s
Success
epollcreate1.cSuccessNone0.055182s0.139620s
Success
error_handling_net.cSuccessNone0.065408s0.202647s
Success
getaddrinfo_test.cSuccessNone0.057069s0.164524s
Success
getaddrinfo_unspec.cSuccessNone0.068640s0.185515s
Success
gethostname.cSuccessNone0.046620s0.109341s
Success
getifaddrs.cSuccessNone0.056373s0.132550s
Success
getsockname.cSuccessNone0.057823s0.135228s
Success
getsockopt.cSuccessNone0.055539s0.164409s
Success
ipv6_basic.cSuccessNone0.058386s0.165917s
Success
makepipe.cSuccessNone0.046649s0.111678s
Success
nonblocking_eagain.cSuccessNone0.059123s0.178317s
Success
pipe.cSuccessNone0.057664s0.135143s
Success
pipe2.cSuccessNone0.057195s0.132998s
Success
pipeinput.cSuccessNone0.057834s0.166992s
Success
pipeinput2.cSuccessNone0.058269s0.173692s
Success
pipeonestring.cSuccessNone0.059815s0.166619s
Success
pipepong.cSuccessNone0.056871s0.173657s
Success
pipewrite.cSuccessNone0.051260s0.126417s
Success
poll.cSuccessNone0.056080s0.123520s
Success
recvfrom-sendto.cSuccessNone0.057123s0.144124s
Success
sendmsg_recvmsg_test.cSuccessNone0.055239s0.138658s
Success
serverclient.cSuccessNone0.055661s0.141633s
Success
shutdown.cSuccessNone0.057411s0.139849s
Success
shutdown_fork.cSuccessNone0.055292s0.153828s
Success
simple-select.cSuccessNone0.057206s0.171334s
Success
simple_epoll.cSuccessNone0.054482s0.131305s
Success
socket.cSuccessNone0.056642s0.122377s
Success
socket_cloexec.cSuccessNone0.054909s0.130556s
Success
socket_options_advanced.cSuccessNone0.062454s0.180497s
Success
socketepoll.cSuccessNone0.052886s0.123059s
Success
socketpair.cSuccessNone0.053157s0.144955s
Success
socketselect.cSuccessNone0.056344s0.137494s
Success
udp_send_recv.cSuccessNone0.161939s0.291348s
Success
uds-getsockname.cSuccessNone0.056733s0.124585s
Success
uds-nb-select.cSuccessNone2.064833s2.201524s
Success
uds-serverclient.cSuccessNone0.060175s0.174138s
Success
uds-socketselect.cSuccessNone0.057505s0.142762s
Success
uds_listen_poll.cSuccessNone1.062962s1.178311s
Success
writev_socket.cSuccessNone0.060358s0.168161s
Success

Fail Tests

Summary

MetricCount
Total Test Cases0
Number of Successes0
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0
wasm-dynamic-linking harness

Test Report

Deterministic Tests

Summary

MetricCount
Total Test Cases7
Number of Successes7
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Dylink Tests
basic.cSuccessNone0.051064s0.128525s
Success
dlopen_fork.cSuccessNone0.051527s0.144944s
Success
dlopen_thread.cSuccessNone0.053126s0.152796s
Success
double_fork_dlopen.cSuccessNone0.055578s0.203928s
Success
fork_dlopen.cSuccessNone0.051472s0.152040s
Success
longjmp_dlopen.cSuccessNone0.048559s0.140556s
Success
rdynamic_main.cSuccessNone0.053522s0.142280s
Success

Fail Tests

Summary

MetricCount
Total Test Cases1
Number of Successes1
Number of Failures0
Number of Compilation Failure Native0
Number of Runtime Failure Native0
Number of Segmentation Fault Native0
Number of Timeout During Native0
Number of Lind Wasm Compile Failure0
Number of Lind Wasm Runtime Failure0
Number of Lind Wasm Segmentation Failure0
Number of Timeout During Lind Wasm run0
Number of Unknown Failure0
Number of C Compiler and Wasm Output mismatch0
Number of Fail Test: Native Succeeded (Should Fail)0
Number of Fail Test: Wasm Succeeded (Should Fail)0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)0
Number of Fail Test: Native Compilation Failure (Should Succeed)0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)0

Test Results by Category

Test CaseStatusError TypeNative TimeWasm TimeOutput
Dylink Tests
dlerror.cSuccessNone0.045651s0.114294s
Success

@Yaxuan-w
Yaxuan-w merged commit 067007a into main Aug 3, 2026
3 checks passed
@Yaxuan-w
Yaxuan-w deleted the classify-unit-test-categories branch August 3, 2026 17:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Classify unit tests and support staged and category-based execution

2 participants