Fuzz Testing : A Weird Issue #1988

AllenOps08 · 2024-07-11T08:22:19Z

AllenOps08
Jul 11, 2024

I run the forge test --mt command twice consecuently and these are the results:



forge test --mt invariant_protocolMustHaveMoreValueThanTotalSupply -vvvv
[⠊] Compiling...
[⠑] Compiling 40 files with Solc 0.8.22
[⠘] Solc 0.8.22 finished in 1.62s
Compiler run successful!

Ran 1 test for test/fuzz/Invariants.t.sol:Invariants
[FAIL. Reason: panic: arithmetic underflow or overflow (0x11)]
        [Sequence]
                sender=0x0000000000000000000000000000000000000235 addr=[test/fuzz/Handler.t.sol:Handler]0x2e234DAe75C793f67A35089C9d99245E1C58470b calldata=depositCollateral(uint256,uint256) args=[94189735502349720083377692405158250862058159711782 [9.418e49], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71]]
 invariant_protocolMustHaveMoreValueThanTotalSupply() (runs: 0, calls: 0, reverts: 0)
Traces:
  [11619678] Invariants::setUp()
    ├─ [4790129] → new DeployDSC@0x5615dEB798BB3E4dFa0139dFa1b3D433Cc23b72f
    │   └─ ← [Return] 23812 bytes of code
    ├─ [5627252] DeployDSC::run()
    │   ├─ [3746933] → new HelperConfig@0x104fBc016F4bb334D775a19E8A6510109AC63E00
    │   │   ├─ [0] VM::startBroadcast()
    │   │   │   └─ ← [Return] 
    │   │   ├─ [372455] → new MockV3Aggregator@0x90193C961A926261B756D1E5bb255e67ff9498A1
    │   │   │   └─ ← [Return] 1083 bytes of code
    │   │   ├─ [658896] → new ERC20Mock@0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496
    │   │   │   ├─ emit Transfer(from: 0x0000000000000000000000000000000000000000, to: DeployDSC: [0x5615dEB798BB3E4dFa0139dFa1b3D433Cc23b72f], value: 100000000000 [1e11])
    │   │   │   └─ ← [Return] 2829 bytes of code
    │   │   ├─ [372455] → new MockV3Aggregator@0xBb2180ebd78ce97360503434eD37fcf4a1Df61c3
    │   │   │   └─ ← [Return] 1083 bytes of code
    │   │   ├─ [658896] → new ERC20Mock@0xDB8cFf278adCCF9E9b5da745B44E754fC4EE3C76
    │   │   │   ├─ emit Transfer(from: 0x0000000000000000000000000000000000000000, to: DeployDSC: [0x5615dEB798BB3E4dFa0139dFa1b3D433Cc23b72f], value: 100000000000 [1e11])
    │   │   │   └─ ← [Return] 2829 bytes of code
    │   │   ├─ [0] VM::stopBroadcast()
    │   │   │   └─ ← [Return] 
    │   │   └─ ← [Return] 6970 bytes of code
    │   ├─ [912] HelperConfig::activeNetworkConfig() [staticcall]
    │   │   └─ ← [Return] MockV3Aggregator: [0x90193C961A926261B756D1E5bb255e67ff9498A1], MockV3Aggregator: [0xBb2180ebd78ce97360503434eD37fcf4a1Df61c3], ERC20Mock: [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496], ERC20Mock: [0xDB8cFf278adCCF9E9b5da745B44E754fC4EE3C76], 77814517325470205911140941194401928579557062014761831930645393041380819009408 [7.781e76]
    │   ├─ [0] VM::startBroadcast(<pk>)
    │   │   └─ ← [Return] 
    │   ├─ [750023] → new DecentralizedStableCoin@0x5FbDB2315678afecb367f032d93F642f64180aa3
    │   │   ├─ emit OwnershipTransferred(previousOwner: 0x0000000000000000000000000000000000000000, newOwner: 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266)
    │   │   └─ ← [Return] 3402 bytes of code
    │   ├─ [889488] → new DSCEngine@0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512
    │   │   └─ ← [Return] 3765 bytes of code
    │   ├─ [2446] DecentralizedStableCoin::transferOwnership(DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512])
    │   │   ├─ emit OwnershipTransferred(previousOwner: 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266, newOwner: DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512])
    │   │   └─ ← [Stop] 
    │   ├─ [0] VM::stopBroadcast()
    │   │   └─ ← [Return] 
    │   └─ ← [Return] DecentralizedStableCoin: [0x5FbDB2315678afecb367f032d93F642f64180aa3], DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], HelperConfig: [0x104fBc016F4bb334D775a19E8A6510109AC63E00]
    ├─ [912] HelperConfig::activeNetworkConfig() [staticcall]
    │   └─ ← [Return] MockV3Aggregator: [0x90193C961A926261B756D1E5bb255e67ff9498A1], MockV3Aggregator: [0xBb2180ebd78ce97360503434eD37fcf4a1Df61c3], ERC20Mock: [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496], ERC20Mock: [0xDB8cFf278adCCF9E9b5da745B44E754fC4EE3C76], 77814517325470205911140941194401928579557062014761831930645393041380819009408 [7.781e76]
    ├─ [946771] → new Handler@0x2e234DAe75C793f67A35089C9d99245E1C58470b
    │   ├─ [1336] DSCEngine::getCollateralTokens() [staticcall]
    │   │   └─ ← [Return] [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496, 0xDB8cFf278adCCF9E9b5da745B44E754fC4EE3C76]
    │   └─ ← [Return] 4160 bytes of code
    └─ ← [Stop] 

  [102940] Handler::depositCollateral(94189735502349720083377692405158250862058159711782 [9.418e49], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    ├─ [29528] ERC20Mock::mint(0x0000000000000000000000000000000000000235, 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   ├─ emit Transfer(from: 0x0000000000000000000000000000000000000000, to: 0x0000000000000000000000000000000000000235, value: 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   └─ ← [Stop] 
    ├─ [0] VM::startPrank(0x0000000000000000000000000000000000000235)
    │   └─ ← [Return] 
    ├─ [24651] ERC20Mock::approve(DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   ├─ emit Approval(owner: 0x0000000000000000000000000000000000000235, spender: DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], value: 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   └─ ← [Return] true
    ├─ [60305] DSCEngine::depositCollateral(ERC20Mock: [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   ├─ emit CollateralDeposited(user: 0x0000000000000000000000000000000000000235, token: ERC20Mock: [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496], amount: 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   ├─ [27689] ERC20Mock::transferFrom(0x0000000000000000000000000000000000000235, DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   │   ├─ emit Approval(owner: 0x0000000000000000000000000000000000000235, spender: DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], value: 0)
    │   │   ├─ emit Transfer(from: 0x0000000000000000000000000000000000000235, to: DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], value: 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   │   └─ ← [Return] true
    │   └─ ← [Stop] 
    ├─ [0] VM::stopPrank()
    │   └─ ← [Return] 
    └─ ← [Stop] 

  [42766] Invariants::invariant_protocolMustHaveMoreValueThanTotalSupply()
    ├─ [2349] DecentralizedStableCoin::totalSupply() [staticcall]
    │   └─ ← [Return] 0
    ├─ [2607] ERC20Mock::balanceOf(DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512]) [staticcall]
    │   └─ ← [Return] 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71]
    ├─ [2607] ERC20Mock::balanceOf(DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512]) [staticcall]
    │   └─ ← [Return] 0
    ├─ [14893] DSCEngine::getUsdInValue(ERC20Mock: [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71]) [staticcall]
    │   ├─ [8993] MockV3Aggregator::latestRoundData() [staticcall]
    │   │   └─ ← [Return] 1, 200000000000 [2e11], 1, 1, 1
    │   └─ ← [Revert] panic: arithmetic underflow or overflow (0x11)
    └─ ← [Revert] panic: arithmetic underflow or overflow (0x11)

Suite result: FAILED. 0 passed; 1 failed; 0 skipped; finished in 8.35ms (7.19ms CPU time)

Ran 1 test suite in 1.25s (8.35ms CPU time): 0 tests passed, 1 failed, 0 skipped (1 total tests)

Failing tests:
Encountered 1 failing test in test/fuzz/Invariants.t.sol:Invariants
[FAIL. Reason: panic: arithmetic underflow or overflow (0x11)]
        [Sequence]
                sender=0x0000000000000000000000000000000000000235 addr=[test/fuzz/Handler.t.sol:Handler]0x2e234DAe75C793f67A35089C9d99245E1C58470b calldata=depositCollateral(uint256,uint256) args=[94189735502349720083377692405158250862058159711782 [9.418e49], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71]]
 invariant_protocolMustHaveMoreValueThanTotalSupply() (runs: 0, calls: 0, reverts: 0)




Encountered a total of 1 failing tests, 0 tests succeeded
allen@LN08:~/foundry/foundry-defi-stablecoin-f23$ forge test --mt invariant_protocolMustHaveMoreValueThanTotalSupply -vvvv
[⠊] Compiling...
No files changed, compilation skipped

Ran 1 test for test/fuzz/Invariants.t.sol:Invariants
[FAIL. Reason: invariant_protocolMustHaveMoreValueThanTotalSupply replay failure]
        [Sequence]
                sender=0x0000000000000000000000000000000000000235 addr=[test/fuzz/Handler.t.sol:Handler]0x2e234DAe75C793f67A35089C9d99245E1C58470b calldata=depositCollateral(uint256,uint256) args=[94189735502349720083377692405158250862058159711782 [9.418e49], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71]]
 invariant_protocolMustHaveMoreValueThanTotalSupply() (runs: 1, calls: 1, reverts: 1)
Traces:
  [11619678] Invariants::setUp()
    ├─ [4790129] → new DeployDSC@0x5615dEB798BB3E4dFa0139dFa1b3D433Cc23b72f
    │   └─ ← [Return] 23812 bytes of code
    ├─ [5627252] DeployDSC::run()
    │   ├─ [3746933] → new HelperConfig@0x104fBc016F4bb334D775a19E8A6510109AC63E00
    │   │   ├─ [0] VM::startBroadcast()
    │   │   │   └─ ← [Return] 
    │   │   ├─ [372455] → new MockV3Aggregator@0x90193C961A926261B756D1E5bb255e67ff9498A1
    │   │   │   └─ ← [Return] 1083 bytes of code
    │   │   ├─ [658896] → new ERC20Mock@0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496
    │   │   │   ├─ emit Transfer(from: 0x0000000000000000000000000000000000000000, to: DeployDSC: [0x5615dEB798BB3E4dFa0139dFa1b3D433Cc23b72f], value: 100000000000 [1e11])
    │   │   │   └─ ← [Return] 2829 bytes of code
    │   │   ├─ [372455] → new MockV3Aggregator@0xBb2180ebd78ce97360503434eD37fcf4a1Df61c3
    │   │   │   └─ ← [Return] 1083 bytes of code
    │   │   ├─ [658896] → new ERC20Mock@0xDB8cFf278adCCF9E9b5da745B44E754fC4EE3C76
    │   │   │   ├─ emit Transfer(from: 0x0000000000000000000000000000000000000000, to: DeployDSC: [0x5615dEB798BB3E4dFa0139dFa1b3D433Cc23b72f], value: 100000000000 [1e11])
    │   │   │   └─ ← [Return] 2829 bytes of code
    │   │   ├─ [0] VM::stopBroadcast()
    │   │   │   └─ ← [Return] 
    │   │   └─ ← [Return] 6970 bytes of code
    │   ├─ [912] HelperConfig::activeNetworkConfig() [staticcall]
    │   │   └─ ← [Return] MockV3Aggregator: [0x90193C961A926261B756D1E5bb255e67ff9498A1], MockV3Aggregator: [0xBb2180ebd78ce97360503434eD37fcf4a1Df61c3], ERC20Mock: [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496], ERC20Mock: [0xDB8cFf278adCCF9E9b5da745B44E754fC4EE3C76], 77814517325470205911140941194401928579557062014761831930645393041380819009408 [7.781e76]
    │   ├─ [0] VM::startBroadcast(<pk>)
    │   │   └─ ← [Return] 
    │   ├─ [750023] → new DecentralizedStableCoin@0x5FbDB2315678afecb367f032d93F642f64180aa3
    │   │   ├─ emit OwnershipTransferred(previousOwner: 0x0000000000000000000000000000000000000000, newOwner: 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266)
    │   │   └─ ← [Return] 3402 bytes of code
    │   ├─ [889488] → new DSCEngine@0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512
    │   │   └─ ← [Return] 3765 bytes of code
    │   ├─ [2446] DecentralizedStableCoin::transferOwnership(DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512])
    │   │   ├─ emit OwnershipTransferred(previousOwner: 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266, newOwner: DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512])
    │   │   └─ ← [Stop] 
    │   ├─ [0] VM::stopBroadcast()
    │   │   └─ ← [Return] 
    │   └─ ← [Return] DecentralizedStableCoin: [0x5FbDB2315678afecb367f032d93F642f64180aa3], DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], HelperConfig: [0x104fBc016F4bb334D775a19E8A6510109AC63E00]
    ├─ [912] HelperConfig::activeNetworkConfig() [staticcall]
    │   └─ ← [Return] MockV3Aggregator: [0x90193C961A926261B756D1E5bb255e67ff9498A1], MockV3Aggregator: [0xBb2180ebd78ce97360503434eD37fcf4a1Df61c3], ERC20Mock: [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496], ERC20Mock: [0xDB8cFf278adCCF9E9b5da745B44E754fC4EE3C76], 77814517325470205911140941194401928579557062014761831930645393041380819009408 [7.781e76]
    ├─ [946771] → new Handler@0x2e234DAe75C793f67A35089C9d99245E1C58470b
    │   ├─ [1336] DSCEngine::getCollateralTokens() [staticcall]
    │   │   └─ ← [Return] [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496, 0xDB8cFf278adCCF9E9b5da745B44E754fC4EE3C76]
    │   └─ ← [Return] 4160 bytes of code
    └─ ← [Stop] 

  [102940] Handler::depositCollateral(94189735502349720083377692405158250862058159711782 [9.418e49], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    ├─ [29528] ERC20Mock::mint(0x0000000000000000000000000000000000000235, 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   ├─ emit Transfer(from: 0x0000000000000000000000000000000000000000, to: 0x0000000000000000000000000000000000000235, value: 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   └─ ← [Stop] 
    ├─ [0] VM::startPrank(0x0000000000000000000000000000000000000235)
    │   └─ ← [Return] 
    ├─ [24651] ERC20Mock::approve(DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   ├─ emit Approval(owner: 0x0000000000000000000000000000000000000235, spender: DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], value: 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   └─ ← [Return] true
    ├─ [60305] DSCEngine::depositCollateral(ERC20Mock: [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   ├─ emit CollateralDeposited(user: 0x0000000000000000000000000000000000000235, token: ERC20Mock: [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496], amount: 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   ├─ [27689] ERC20Mock::transferFrom(0x0000000000000000000000000000000000000235, DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   │   ├─ emit Approval(owner: 0x0000000000000000000000000000000000000235, spender: DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], value: 0)
    │   │   ├─ emit Transfer(from: 0x0000000000000000000000000000000000000235, to: DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512], value: 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71])
    │   │   └─ ← [Return] true
    │   └─ ← [Stop] 
    ├─ [0] VM::stopPrank()
    │   └─ ← [Return] 
    └─ ← [Stop] 

  [42766] Invariants::invariant_protocolMustHaveMoreValueThanTotalSupply()
    ├─ [2349] DecentralizedStableCoin::totalSupply() [staticcall]
    │   └─ ← [Return] 0
    ├─ [2607] ERC20Mock::balanceOf(DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512]) [staticcall]
    │   └─ ← [Return] 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71]
    ├─ [2607] ERC20Mock::balanceOf(DSCEngine: [0xe7f1725E7734CE288F8367e1Bb143E90bb3F0512]) [staticcall]
    │   └─ ← [Return] 0
    ├─ [14893] DSCEngine::getUsdInValue(ERC20Mock: [0xA8452Ec99ce0C64f20701dB7dD3abDb607c00496], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71]) [staticcall]
    │   ├─ [8993] MockV3Aggregator::latestRoundData() [staticcall]
    │   │   └─ ← [Return] 1, 200000000000 [2e11], 1, 1, 1
    │   └─ ← [Revert] panic: arithmetic underflow or overflow (0x11)
    └─ ← [Revert] panic: arithmetic underflow or overflow (0x11)

Suite result: FAILED. 0 passed; 1 failed; 0 skipped; finished in 1.70ms (567.02µs CPU time)

Ran 1 test suite in 1.21s (1.70ms CPU time): 0 tests passed, 1 failed, 0 skipped (1 total tests)

Failing tests:
Encountered 1 failing test in test/fuzz/Invariants.t.sol:Invariants
[FAIL. Reason: invariant_protocolMustHaveMoreValueThanTotalSupply replay failure]
        [Sequence]
                sender=0x0000000000000000000000000000000000000235 addr=[test/fuzz/Handler.t.sol:Handler]0x2e234DAe75C793f67A35089C9d99245E1C58470b calldata=depositCollateral(uint256,uint256) args=[94189735502349720083377692405158250862058159711782 [9.418e49], 108853769965199329430027059539153257474217107405332668688119928256337071 [1.088e71]]
 invariant_protocolMustHaveMoreValueThanTotalSupply() (runs: 1, calls: 1, reverts: 1)

Encountered a total of 1 failing tests, 0 tests succeeded
allen@LN08:~/foundry/foundry-defi-stablecoin-f23$

EngrPips · 2024-07-11T09:04:55Z

EngrPips
Jul 11, 2024

Maybe run forge clean, and forge build, then run your test again. It might be caching stuff and use them for any similar process.

2 replies

tamermint Jul 15, 2024

This helped me with another weird revert - thank you - Foundry was caching a typical arg for that function which wasn't in the range I had bounded - this worked as well

EngrPips Jul 15, 2024

Awesome. Keep crushing it.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fuzz Testing : A Weird Issue #1988

{{title}}

Replies: 1 comment 2 replies

{{title}}

{{title}}

{{title}}

Select a reply

Fuzz Testing : A Weird Issue #1988

AllenOps08 Jul 11, 2024

Replies: 1 comment · 2 replies

EngrPips Jul 11, 2024

tamermint Jul 15, 2024

EngrPips Jul 15, 2024

AllenOps08
Jul 11, 2024

Replies: 1 comment 2 replies

EngrPips
Jul 11, 2024