New pytest test runner

[mandli]

Uses the new ClawpackTestRunner to do testing. See clawpack/clawutil#187 for discussion and details.

[mandli]

Turns out that some of the optimization flags are more sensitive that I had thought. All the tests are passing in the entire matrix now though! Note that for optimization flags that something more aggressive than -O1 may not work.

[mjberger]

Just to confirm, you're staying that -O2 won't work for unit testing, not that we shouldn't use ourselves.

…

On Mar 16, 2026, at 6:30 PM, Kyle Mandli ***@***.***> wrote: mandli left a comment (clawpack/amrclaw#310) <https://urldefense.com/v3/__https://github.com/clawpack/amrclaw/pull/310*issuecomment-4071039292__;Iw!!DSb-azq1wVFtOg!VkfQAI9xCI2rHeafuTLTgGYcUkXFE7H92kpzOTAsZVuFmt1XOFbdM2R4ZfX2kHmcN8YYL_LbSWBFrptkYOgBPy7pxb9UjWk$> Turns out that some of the optimization flags are more sensitive that I had thought. All the tests are passing in the entire matrix now though! Note that for optimization flags that something more aggressive than -O1 may not work. — Reply to this email directly, view it on GitHub <https://urldefense.com/v3/__https://github.com/clawpack/amrclaw/pull/310*issuecomment-4071039292__;Iw!!DSb-azq1wVFtOg!VkfQAI9xCI2rHeafuTLTgGYcUkXFE7H92kpzOTAsZVuFmt1XOFbdM2R4ZfX2kHmcN8YYL_LbSWBFrptkYOgBPy7pxb9UjWk$>, or unsubscribe <https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/AAGUGCZS66HZRSUVXTIT5TT4RB6ADAVCNFSM6AAAAACWTXJ5XKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DANZRGAZTSMRZGI__;!!DSb-azq1wVFtOg!VkfQAI9xCI2rHeafuTLTgGYcUkXFE7H92kpzOTAsZVuFmt1XOFbdM2R4ZfX2kHmcN8YYL_LbSWBFrptkYOgBPy7pkSQjeo0$>. You are receiving this because you are subscribed to this thread.

[mandli]

Yes, the tests themselves are susceptible to this, but in general this is not an issue. The adjoint tests seem to be the most sensitive, but the acoustics 2D radial problem also seems to have issues.

[rjleveque]

@mandli: good to know, thanks for tracking this down!

[mandli]

I think I am close to working out all the issues with the new testing framework, but still working on getting test result archiving and a couple of other bugs working. Things that I probably won't get to, but can get added later:

1. Additional test suites, such as slow, or plotting. Right now there's just regression, and a couple of tests are marked as slow or adjoint to help default testing.
2. All the AMRClaw tests pass, but there are some places we could extend coverage.
3. Additional things in GeoClaw, but I will detail that in Switch to Using ClawpackTestRunner for Testing geoclaw#697

[rjleveque]

Merging this along with clawpack/classic#96 and clawpack/geoclaw#697, which has some additional details on tests.