Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

The node will get stuck every once in a while. #12986

Open
volare-v opened this issue Dec 4, 2024 · 4 comments
Open

The node will get stuck every once in a while. #12986

volare-v opened this issue Dec 4, 2024 · 4 comments
Labels
imp2 Medium importance

Comments

@volare-v
Copy link

volare-v commented Dec 4, 2024

System information

Erigon version: v2.60.10

OS & Version: ubuntu 24.04

Commit hash: 2c8003c6ef93df8a94464733654da23885cd7c8c

Erigon Command (with flags/config):

./erigon/build/bin/erigon --datadir=./data --config ./config.toml

internalcl = true

port = 38336

http = true
"http.addr" = "0.0.0.0"
"http.port" = 8036
"http.api" = ["eth","web3","net","debug","trace","txpool"]
"http.corsdomain" = ["*"]
"http.vhosts" = ["*"]
#"http.compression" = true

ws = true
"ws.port" = 8036
#"ws.compression" = true

"snap.keepblocks" = true
"authrpc.port" = 8536
"private.api.addr" = ""
"torrent.port" = 8136
"torrent.download.rate" = "512mb"
"nat" = "none"

"prune" = ["c"]
"prune.c.older" = 1000000

"diagnostics.disabled" = true

Consensus Layer: internalcl

Chain/Network: mainnet

Expected behaviour

synchronizing one block at a time.

Actual behaviour

The node will get stuck every once in a while. After waiting for a period of time, it will synchronize many blocks (30-200) at once. After cycling for several hours, it will return to its normal state.

Restarting the node is useless.

Steps to reproduce the behaviour

Normal synchronization node.

Backtrace

[INFO] [12-03|03:55:09.093] [4/12 Execution] Completed on            block=21319424
[INFO] [12-03|03:55:13.379] RPC Daemon notified of new headers       from=21319422 to=21319424 amount=2 hash=0x662a7cbbcd1fbab23b25137269e16a19da0bf5511ac51129206aedca2216f3ea header sending=23.229µs log sending=334ns
[INFO] [12-03|03:55:13.379] head updated                             hash=0x662a7cbbcd1fbab23b25137269e16a19da0bf5511ac51129206aedca2216f3ea number=21319424
[INFO] [12-03|03:55:21.051] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload) 
[INFO] [12-03|03:55:27.898] RPC Daemon notified of new headers       from=21319424 to=21319425 amount=1 hash=0x2b0a93bca859c9f4941a06e9b6a1d18112c39042ca7350f6835fd20f74102f81 header sending=13.964µs log sending=339ns
[INFO] [12-03|03:55:27.898] head updated                             hash=0x2b0a93bca859c9f4941a06e9b6a1d18112c39042ca7350f6835fd20f74102f81 number=21319425
[INFO] [12-03|03:55:33.180] [4/12 Execution] Completed on            block=21319426
[INFO] [12-03|03:55:34.646] RPC Daemon notified of new headers       from=21319425 to=21319426 amount=1 hash=0x51997402ae7b2dcea171558fb7943611730272e5c20871c67a261a866a5d692d header sending=16.814µs log sending=427ns
[INFO] [12-03|03:55:34.646] head updated                             hash=0x51997402ae7b2dcea171558fb7943611730272e5c20871c67a261a866a5d692d number=21319426
[INFO] [12-03|03:55:40.224] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload) 
[INFO] [12-03|03:55:40.915] P2P                                      app=caplin peers=49
[INFO] [12-03|03:55:41.202] RPC Daemon notified of new headers       from=21319426 to=21319427 amount=1 hash=0xc986317316fd316132e81112ba31d90bb9427f71ae9f9afd32b60e657a768f6b header sending=14.907µs log sending=333ns
[INFO] [12-03|03:55:41.202] head updated                             hash=0xc986317316fd316132e81112ba31d90bb9427f71ae9f9afd32b60e657a768f6b number=21319427
[INFO] [12-03|03:56:03.954] [4/12 Execution] Completed on            block=21319429
[INFO] [12-03|03:56:08.857] RPC Daemon notified of new headers       from=21319427 to=21319429 amount=2 hash=0x1431b29afbbe1107b0dcdcfa6a468b0af10201a6ddd04ea83112ce93676ed040 header sending=17.557µs log sending=285ns
[INFO] [12-03|03:56:08.857] head updated                             hash=0x1431b29afbbe1107b0dcdcfa6a468b0af10201a6ddd04ea83112ce93676ed040 number=21319429
[INFO] [12-03|03:56:35.181] [4/12 Execution] Completed on            block=21319431
[INFO] [12-03|03:56:40.915] P2P                                      app=caplin peers=59
[INFO] [12-03|03:56:46.658] [p2p] GoodPeers                          eth68=100 eth67=76 eth66=19
[INFO] [12-03|03:56:47.580] [mem] memory stats                       Rss=27.0GB Size=0B Pss=27.0GB SharedClean=34.0MB SharedDirty=0B PrivateClean=1.8GB PrivateDirty=25.2GB Referenced=24.5GB Anonymous=25.2GB Swap=41.5MB alloc=10.2GB sys=22.9GB
[INFO] [12-03|03:56:49.796] RPC Daemon notified of new headers       from=21319429 to=21319431 amount=2 hash=0xe2e9d5e514373c5e9fa23885aba11524118e555a1112174fbc553601dcd05b5b header sending=15.563µs log sending=404ns
[INFO] [12-03|03:56:49.796] head updated                             hash=0xe2e9d5e514373c5e9fa23885aba11524118e555a1112174fbc553601dcd05b5b number=21319431
[INFO] [12-03|03:56:50.480] [txpool] stat                            pending=6417 baseFee=5739 queued=2277 alloc=10.7GB sys=22.9GB
[WARN] [12-03|03:56:54.327] [rpc] served                             conn=185.87.48.4:46008 method=eth_accounts reqid=2 t=51.075µs err="the method has been deprecated: eth_accounts"
[WARN] [12-03|03:56:54.396] [rpc] served                             conn=185.87.48.4:46022 method=eth_coinbase reqid=2 t=45.093µs err="etherbase must be explicitly specified"
[INFO] [12-03|03:57:40.915] P2P                                      app=caplin peers=59
[INFO] [12-03|03:58:25.837] [4/12 Execution] Completed on            block=21319439
[INFO] [12-03|03:58:40.915] P2P                                      app=caplin peers=74
[WARN] [12-03|03:58:54.473] [rpc] served                             conn=185.87.48.4:43162 method=eth_coinbase reqid=2 t=60.607µs err="etherbase must be explicitly specified"
[WARN] [12-03|03:58:54.503] [rpc] served                             conn=194.67.206.44:40676 method=eth_accounts reqid=2 t=30.954µs err="the method has been deprecated: eth_accounts"
[INFO] [12-03|03:59:08.505] RPC Daemon notified of new headers       from=21319431 to=21319439 amount=8 hash=0x66835f3b9b8b067fb8a2f6ce718e89c81c8621d3f6bfb2f7f9099b57d2cde413 header sending=22.963µs log sending=577ns
[INFO] [12-03|03:59:08.505] head updated                             hash=0x66835f3b9b8b067fb8a2f6ce718e89c81c8621d3f6bfb2f7f9099b57d2cde413 number=21319439
[INFO] [12-03|03:59:40.915] P2P                                      app=caplin peers=61
[INFO] [12-03|03:59:46.657] [p2p] GoodPeers                          eth68=100 eth67=76 eth66=19
[INFO] [12-03|03:59:49.655] [mem] memory stats                       Rss=37.3GB Size=0B Pss=35.9GB SharedClean=2.8GB SharedDirty=0B PrivateClean=3.8GB PrivateDirty=30.8GB Referenced=32.8GB Anonymous=30.8GB Swap=48.2MB alloc=14.7GB sys=22.9GB
[INFO] [12-03|03:59:50.620] [txpool] stat                            pending=6831 baseFee=5821 queued=2344 alloc=14.9GB sys=22.9GB
[INFO] [12-03|04:00:40.915] P2P                                      app=caplin peers=56
[WARN] [12-03|04:00:54.994] [rpc] served                             conn=194.67.206.44:39032 method=eth_coinbase reqid=2 t=52.036µs err="etherbase must be explicitly specified"
[WARN] [12-03|04:00:55.002] [rpc] served                             conn=194.67.206.45:59742 method=eth_accounts reqid=2 t=49.89µs err="the method has been deprecated: eth_accounts"
[INFO] [12-03|04:01:13.382] [4/12 Execution] Completed on            block=21319453
[INFO] [12-03|04:01:40.915] P2P                                      app=caplin peers=56
[INFO] [12-03|04:02:01.713] RPC Daemon notified of new headers       from=21319439 to=21319453 amount=14 hash=0x954103a49339513321cab021cf8bd8bba5cc0f59d677eaa287a2aa4de9bb0430 header sending=233.17µs log sending=330ns
[INFO] [12-03|04:02:01.713] head updated                             hash=0x954103a49339513321cab021cf8bd8bba5cc0f59d677eaa287a2aa4de9bb0430 number=21319453
[INFO] [12-03|04:02:40.915] P2P                                      app=caplin peers=55
[INFO] [12-03|04:02:46.658] [p2p] GoodPeers                          eth68=100 eth67=76 eth66=19
[INFO] [12-03|04:02:49.686] [mem] memory stats                       Rss=35.6GB Size=0B Pss=34.2GB SharedClean=2.8GB SharedDirty=0B PrivateClean=3.4GB PrivateDirty=29.5GB Referenced=31.1GB Anonymous=29.5GB Swap=48.2MB alloc=12.2GB sys=22.9GB
[INFO] [12-03|04:02:50.460] [txpool] stat                            pending=7023 baseFee=5904 queued=2363 alloc=12.5GB sys=22.9GB
[WARN] [12-03|04:02:54.338] [rpc] served                             conn=194.67.206.46:36274 method=eth_coinbase reqid=2 t=84.913µs err="etherbase must be explicitly specified"
[WARN] [12-03|04:02:54.373] [rpc] served                             conn=194.67.206.49:52614 method=eth_accounts reqid=2 t=77.635µs err="the method has been deprecated: eth_accounts"
[INFO] [12-03|04:03:18.076] [4/12 Execution] Completed on            block=21319464
[INFO] [12-03|04:03:40.915] P2P                                      app=caplin peers=56
[INFO] [12-03|04:04:03.430] RPC Daemon notified of new headers       from=21319453 to=21319464 amount=11 hash=0x3f571a7dbe191624217982a8da8e06c2054a977d08f9af350c8e0a21a4290d3b header sending=35.019µs log sending=470ns
[INFO] [12-03|04:04:03.430] head updated                             hash=0x3f571a7dbe191624217982a8da8e06c2054a977d08f9af350c8e0a21a4290d3b number=21319464
[INFO] [12-03|04:04:31.788] [4/12 Execution] Completed on            block=21319471
[INFO] [12-03|04:04:40.915] P2P                                      app=caplin peers=55
[WARN] [12-03|04:04:55.156] [rpc] served                             conn=194.67.206.45:34360 method=eth_accounts reqid=2 t=63.692µs err="the method has been deprecated: eth_accounts"
[WARN] [12-03|04:04:55.190] [rpc] served                             conn=194.67.206.45:34364 method=eth_coinbase reqid=2 t=46.741µs err="etherbase must be explicitly specified"
[INFO] [12-03|04:04:55.508] RPC Daemon notified of new headers       from=21319464 to=21319471 amount=7 hash=0xfdd21b53a439cbf4f67dd57964166f6a59410fd6937a3a972a90afc59ce0af72 header sending=23.805µs log sending=333ns
[INFO] [12-03|04:04:55.508] head updated                             hash=0xfdd21b53a439cbf4f67dd57964166f6a59410fd6937a3a972a90afc59ce0af72 number=21319471
[INFO] [12-03|04:05:40.915] P2P                                      app=caplin peers=52
[INFO] [12-03|04:05:43.696] [4/12 Execution] Completed on            block=21319476
[INFO] [12-03|04:05:46.658] [p2p] GoodPeers                          eth68=100 eth67=76 eth66=19
[INFO] [12-03|04:05:49.252] [mem] memory stats                       Rss=29.8GB Size=0B Pss=29.1GB SharedClean=1.4GB SharedDirty=0B PrivateClean=2.1GB PrivateDirty=26.3GB Referenced=27.2GB Anonymous=26.3GB Swap=42.7MB alloc=14.0GB sys=22.9GB
[INFO] [12-03|04:05:50.559] [txpool] stat                            pending=6726 baseFee=6005 queued=2309 alloc=14.1GB sys=22.9GB
[INFO] [12-03|04:06:13.211] RPC Daemon notified of new headers       from=21319471 to=21319476 amount=5 hash=0xf79851f19d94fc4c2e582ab7f9e7f25d02e0bd977116c71e41f34ee947a7fd57 header sending=20.178µs log sending=363ns
[INFO] [12-03|04:06:13.211] head updated                             hash=0xf79851f19d94fc4c2e582ab7f9e7f25d02e0bd977116c71e41f34ee947a7fd57 number=21319476
[INFO] [12-03|04:06:40.915] P2P                                      app=caplin peers=51
[WARN] [12-03|04:06:54.329] [rpc] served                             conn=185.87.48.4:55368 method=eth_coinbase reqid=2 t=60.449µs err="etherbase must be explicitly specified"
[WARN] [12-03|04:06:54.344] [rpc] served                             conn=185.87.48.4:55384 method=eth_accounts reqid=2 t=63.685µs err="the method has been deprecated: eth_accounts"
[INFO] [12-03|04:07:40.915] P2P                                      app=caplin peers=52
[INFO] [12-03|04:07:58.978] [7/7 IntermediateHashes] Calculating Merkle root current key=7ff6f895
[INFO] [12-03|04:08:40.915] P2P                                      app=caplin peers=48
[INFO] [12-03|04:08:46.658] [p2p] GoodPeers                          eth68=100 eth67=77 eth66=19
[INFO] [12-03|04:08:49.591] [mem] memory stats                       Rss=35.2GB Size=0B Pss=33.8GB SharedClean=2.8GB SharedDirty=0B PrivateClean=3.6GB PrivateDirty=28.8GB Referenced=30.7GB Anonymous=28.8GB Swap=48.0MB alloc=15.1GB sys=22.9GB
[INFO] [12-03|04:08:50.532] [txpool] stat                            pending=7558 baseFee=5963 queued=2364 alloc=15.2GB sys=22.9GB
[WARN] [12-03|04:08:54.399] [rpc] served                             conn=194.67.206.50:56608 method=eth_accounts reqid=2 t=93.994µs err="the method has been deprecated: eth_accounts"
[WARN] [12-03|04:08:54.416] [rpc] served                             conn=185.87.48.4:35940 method=eth_coinbase reqid=2 t=53.13µs err="etherbase must be explicitly specified"
[INFO] [12-03|04:09:40.915] P2P                                      app=caplin peers=59
[INFO] [12-03|04:09:45.103] [7/7 IntermediateHashes] Calculating Merkle root current key=9f74bd40
[INFO] [12-03|04:10:40.915] P2P                                      app=caplin peers=60
[WARN] [12-03|04:10:54.323] [rpc] served                             conn=185.87.48.4:36880 method=eth_coinbase reqid=2 t=78.675µs err="etherbase must be explicitly specified"
[WARN] [12-03|04:10:54.384] [rpc] served                             conn=194.67.206.44:59820 method=eth_accounts reqid=2 t=42.856µs err="the method has been deprecated: eth_accounts"
[INFO] [12-03|04:11:01.744] [7/7 IntermediateHashes] Calculating Merkle root current key=b2f0ee20
[INFO] [12-03|04:11:40.915] P2P                                      app=caplin peers=60
[INFO] [12-03|04:11:46.658] [p2p] GoodPeers                          eth68=100 eth67=77 eth66=19
[INFO] [12-03|04:11:49.658] [mem] memory stats                       Rss=35.0GB Size=0B Pss=33.6GB SharedClean=2.8GB SharedDirty=0B PrivateClean=3.7GB PrivateDirty=28.5GB Referenced=30.5GB Anonymous=28.5GB Swap=48.0MB alloc=13.1GB sys=22.9GB
[INFO] [12-03|04:11:50.500] [txpool] stat                            pending=8487 baseFee=6189 queued=2448 alloc=13.2GB sys=22.9GB
[INFO] [12-03|04:12:00.871] [7/7 IntermediateHashes] Calculating Merkle root current key=9ac6b25b
[INFO] [12-03|04:12:40.915] P2P                                      app=caplin peers=52
[WARN] [12-03|04:12:54.373] [rpc] served                             conn=185.87.48.4:57072 method=eth_accounts reqid=2 t=73.949µs err="the method has been deprecated: eth_accounts"
[WARN] [12-03|04:12:54.382] [rpc] served                             conn=194.67.206.50:36028 method=eth_coinbase reqid=2 t=75.446µs err="etherbase must be explicitly specified"
[INFO] [12-03|04:13:40.915] P2P                                      app=caplin peers=70
[INFO] [12-03|04:14:28.366] [7/7 IntermediateHashes] Calculating Merkle root current key=7b5855bb
[INFO] [12-03|04:14:40.915] P2P                                      app=caplin peers=61
[INFO] [12-03|04:14:46.658] [p2p] GoodPeers                          eth67=77 eth68=99 eth66=19
[INFO] [12-03|04:14:49.646] [mem] memory stats                       Rss=34.9GB Size=0B Pss=33.5GB SharedClean=2.8GB SharedDirty=0B PrivateClean=3.7GB PrivateDirty=28.5GB Referenced=30.4GB Anonymous=28.5GB Swap=48.0MB alloc=12.7GB sys=22.9GB
[INFO] [12-03|04:14:50.497] [txpool] stat                            pending=9340 baseFee=6527 queued=2542 alloc=12.8GB sys=22.9GB
[WARN] [12-03|04:14:55.103] [rpc] served                             conn=194.67.206.44:57854 method=eth_coinbase reqid=2 t=98.442µs err="etherbase must be explicitly specified"
[WARN] [12-03|04:14:55.117] [rpc] served                             conn=185.87.48.4:58802 method=eth_accounts reqid=2 t=81.141µs err="the method has been deprecated: eth_accounts"
[INFO] [12-03|04:15:40.915] P2P                                      app=caplin peers=66
[INFO] [12-03|04:16:40.915] P2P                                      app=caplin peers=63
[WARN] [12-03|04:16:54.299] [rpc] served                             conn=185.87.48.4:46316 method=eth_coinbase reqid=2 t=91.701µs err="etherbase must be explicitly specified"
[WARN] [12-03|04:16:54.343] [rpc] served                             conn=194.67.206.49:44846 method=eth_accounts reqid=2 t=28.687µs err="the method has been deprecated: eth_accounts"
[INFO] [12-03|04:17:40.915] P2P                                      app=caplin peers=72
[INFO] [12-03|04:17:46.658] [p2p] GoodPeers                          eth66=19 eth68=100 eth67=77
[INFO] [12-03|04:17:49.607] [mem] memory stats                       Rss=34.4GB Size=0B Pss=33.0GB SharedClean=2.8GB SharedDirty=0B PrivateClean=3.1GB PrivateDirty=28.5GB Referenced=29.7GB Anonymous=28.5GB Swap=47.8MB alloc=13.7GB sys=22.9GB
[INFO] [12-03|04:17:50.460] [txpool] stat                            pending=10000 baseFee=6841 queued=2702 alloc=13.8GB sys=22.9GB
[INFO] [12-03|04:18:40.915] P2P                                      app=caplin peers=68
[INFO] [12-03|04:19:40.915] P2P                                      app=caplin peers=71
[WARN] [12-03|04:19:53.263] [rpc] served                             conn=185.87.48.4:54480 method=eth_accounts reqid=2 t=49.326µs err="the method has been deprecated: eth_accounts"
[WARN] [12-03|04:19:53.277] [rpc] served                             conn=185.87.48.4:54470 method=eth_coinbase reqid=2 t=36.74µs err="etherbase must be explicitly specified"
[INFO] [12-03|04:20:00.334] [7/7 IntermediateHashes] Calculating Merkle root current key=741c06f4
[INFO] [12-03|04:20:30.202] [7/7 IntermediateHashes] Calculating Merkle root current key=e93899da
[INFO] [12-03|04:20:40.915] P2P                                      app=caplin peers=63
[INFO] [12-03|04:20:46.658] [p2p] GoodPeers                          eth67=77 eth66=19 eth68=100
[INFO] [12-03|04:20:49.634] [mem] memory stats                       Rss=35.6GB Size=0B Pss=34.3GB SharedClean=2.8GB SharedDirty=0B PrivateClean=4.4GB PrivateDirty=28.5GB Referenced=30.6GB Anonymous=28.5GB Swap=47.2MB alloc=12.4GB sys=22.9GB
[INFO] [12-03|04:20:50.458] [txpool] stat                            pending=10000 baseFee=7013 queued=2929 alloc=12.4GB sys=22.9GB
[INFO] [12-03|04:21:05.261] [3/12 Senders] Started                   from=21319476 to=21319553
[INFO] [12-03|04:21:17.471] [4/12 Execution] Blocks execution        from=21319476 to=21319553
[INFO] [12-03|04:21:40.915] P2P                                      app=caplin peers=52
[WARN] [12-03|04:22:00.275] [rpc] served                             conn=185.87.48.4:44196 method=eth_coinbase reqid=2 t=138.367µs err="etherbase must be explicitly specified"
[WARN] [12-03|04:22:01.008] [rpc] served                             conn=194.67.206.50:49906 method=eth_accounts reqid=2 t=75.145µs err="the method has been deprecated: eth_accounts"
[INFO] [12-03|04:22:01.821] [4/12 Execution] Executed blocks         number=21319509 blk/s=0.7 tx/s=130.8 Mgas/s=11.3 gasState=0.00 batch=1.1MB alloc=8.6GB sys=22.9GB
[INFO] [12-03|04:22:17.622] [4/12 Execution] Executed blocks         number=21319535 blk/s=1.6 tx/s=288.3 Mgas/s=24.4 gasState=0.00 batch=1.7MB alloc=12.6GB sys=22.9GB
[INFO] [12-03|04:22:40.915] P2P                                      app=caplin peers=56
[INFO] [12-03|04:22:41.579] [4/12 Execution] Completed on            block=21319553
[INFO] [12-03|04:22:41.580] [4/12 Execution] DONE                    in=1m24.108628546s
[INFO] [12-03|04:22:41.580] [5/12 HashState] Promoting plain state   from=21319476 to=21319553
[INFO] [12-03|04:22:41.580] [5/12 HashState] Incremental promotion   from=21319476 to=21319553 codes=true csbucket=AccountChangeSet
[INFO] [12-03|04:22:48.520] [5/12 HashState] Incremental promotion   from=21319476 to=21319553 codes=false csbucket=AccountChangeSet
[INFO] [12-03|04:23:01.349] [5/12 HashState] Incremental promotion   from=21319476 to=21319553 codes=false csbucket=StorageChangeSet
[INFO] [12-03|04:23:25.955] [6/12 IntermediateHashes] Generating intermediate hashes from=21319476 to=21319553
[INFO] [12-03|04:23:40.915] P2P                                      app=caplin peers=53
[INFO] [12-03|04:23:46.657] [p2p] GoodPeers                          eth68=100 eth66=19 eth67=77
[INFO] [12-03|04:23:49.588] [mem] memory stats                       Rss=37.0GB Size=0B Pss=36.0GB SharedClean=2.0GB SharedDirty=0B PrivateClean=5.4GB PrivateDirty=29.6GB Referenced=32.1GB Anonymous=29.6GB Swap=47.1MB alloc=12.7GB sys=22.9GB
[INFO] [12-03|04:23:50.453] [txpool] stat                            pending=10000 baseFee=7180 queued=3091 alloc=13.0GB sys=22.9GB
[INFO] [12-03|04:23:56.232] [6/12 IntermediateHashes] Calculating Merkle root current key=5d0edb2b
[WARN] [12-03|04:24:00.375] [rpc] served                             conn=185.87.48.4:47040 method=eth_accounts reqid=2 t=74.785µs err="the method has been deprecated: eth_accounts"
[WARN] [12-03|04:24:00.393] [rpc] served                             conn=194.67.206.50:59414 method=eth_coinbase reqid=2 t=76.869µs err="etherbase must be explicitly specified"
[INFO] [12-03|04:24:26.460] [6/12 IntermediateHashes] Calculating Merkle root current key=ab14d688
[INFO] [12-03|04:24:40.915] P2P                                      app=caplin peers=60
[INFO] [12-03|04:24:55.978] [6/12 IntermediateHashes] DONE           in=1m30.023085871s
[INFO] [12-03|04:24:56.070] [7/12 CallTraces] Pruned call trace intermediate table from=21229476 to=21229552
[INFO] [12-03|04:25:40.915] P2P                                      app=caplin peers=62
[WARN] [12-03|04:26:01.301] [rpc] served                             conn=194.67.206.45:50332 method=eth_accounts reqid=2 t=76.297µs err="the method has been deprecated: eth_accounts"
[WARN] [12-03|04:26:01.521] [rpc] served                             conn=194.67.206.43:56940 method=eth_coinbase reqid=2 t=72.798µs err="etherbase must be explicitly specified"
[INFO] [12-03|04:26:36.164] RPC Daemon notified of new headers       from=21319476 to=21319553 amount=77 hash=0xf0037319764dc2f180e31a10dca19182c8314851ed7be8e3aca824969d9be1ef header sending=1.350068ms log sending=352ns
[INFO] [12-03|04:26:36.164] head updated                             hash=0xf0037319764dc2f180e31a10dca19182c8314851ed7be8e3aca824969d9be1ef number=21319553
[INFO] [12-03|04:26:40.915] P2P                                      app=caplin peers=58
[INFO] [12-03|04:26:46.658] [p2p] GoodPeers                          eth68=100 eth67=77 eth66=19
[INFO] [12-03|04:26:49.746] [mem] memory stats                       Rss=37.9GB Size=0B Pss=36.9GB SharedClean=2.0GB SharedDirty=0B PrivateClean=7.0GB PrivateDirty=28.9GB Referenced=33.0GB Anonymous=28.9GB Swap=47.1MB alloc=15.4GB sys=22.9GB
[INFO] [12-03|04:26:50.495] [txpool] stat                            pending=7260 baseFee=6121 queued=2573 alloc=11.6GB sys=22.9GB
[INFO] [12-03|04:27:10.968] [3/12 Senders] Started                   from=21319553 to=21319583
[INFO] [12-03|04:27:11.021] [4/12 Execution] Blocks execution        from=21319553 to=21319583
[INFO] [12-03|04:27:39.512] [4/12 Execution] Completed on            block=21319583
[INFO] [12-03|04:27:39.512] [5/12 HashState] Promoting plain state   from=21319553 to=21319583
[INFO] [12-03|04:27:39.512] [5/12 HashState] Incremental promotion   from=21319553 to=21319583 codes=true csbucket=AccountChangeSet
[INFO] [12-03|04:27:40.915] P2P                                      app=caplin peers=52
[INFO] [12-03|04:27:46.133] [5/12 HashState] Incremental promotion   from=21319553 to=21319583 codes=false csbucket=AccountChangeSet
[INFO] [12-03|04:27:58.893] [5/12 HashState] Incremental promotion   from=21319553 to=21319583 codes=false csbucket=StorageChangeSet
[WARN] [12-03|04:28:00.375] [rpc] served                             conn=194.67.206.50:44108 method=eth_coinbase reqid=2 t=43.247µs err="etherbase must be explicitly specified"
[WARN] [12-03|04:28:00.382] [rpc] served                             conn=185.87.48.4:40122 method=eth_accounts reqid=2 t=33.043µs err="the method has been deprecated: eth_accounts"
[INFO] [12-03|04:28:06.125] [6/12 IntermediateHashes] Generating intermediate hashes from=21319553 to=21319583
[INFO] [12-03|04:28:36.214] [6/12 IntermediateHashes] Calculating Merkle root current key=9ef7b790
[INFO] [12-03|04:28:40.915] P2P                                      app=caplin peers=69
[INFO] [12-03|04:28:46.754] [7/12 CallTraces] Pruned call trace intermediate table from=21229553 to=21229582
[INFO] [12-03|04:29:37.134] RPC Daemon notified of new headers       from=21319553 to=21319583 amount=30 hash=0xf23e44064356961dec7a0f4f1db72a4aecb88b1dc9b6ab5cf3986646c2040c94 header sending=107.243487ms log sending=883ns
[INFO] [12-03|04:29:37.135] head updated                             hash=0xf23e44064356961dec7a0f4f1db72a4aecb88b1dc9b6ab5cf3986646c2040c94 number=21319583
[INFO] [12-03|04:29:40.918] P2P                                      app=caplin peers=49
[INFO] [12-03|04:29:46.658] [p2p] GoodPeers                          eth67=77 eth66=19 eth68=100
[INFO] [12-03|04:29:49.906] [mem] memory stats                       Rss=38.8GB Size=0B Pss=37.8GB SharedClean=2.0GB SharedDirty=0B PrivateClean=6.7GB PrivateDirty=30.1GB Referenced=33.9GB Anonymous=30.1GB Swap=47.2MB alloc=10.3GB sys=22.9GB
[INFO] [12-03|04:29:54.641] [txpool] stat                            pending=7307 baseFee=5819 queued=2352 alloc=10.9GB sys=22.9GB
[WARN] [12-03|04:30:00.499] [rpc] served                             conn=194.67.206.44:37450 method=eth_accounts reqid=2 t=43.92µs err="the method has been deprecated: eth_accounts"
[WARN] [12-03|04:30:00.722] [rpc] served                             conn=194.67.206.50:54890 method=eth_coinbase reqid=2 t=75.953µs err="etherbase must be explicitly specified"
[INFO] [12-03|04:30:40.915] P2P                                      app=caplin peers=55
[INFO] [12-03|04:31:22.674] [3/12 Senders] Started                   from=21319583 to=21319603
[INFO] [12-03|04:31:22.733] [4/12 Execution] Blocks execution        from=21319583 to=21319603
@AskAlexSharov
Copy link
Collaborator

@volare-v

  • set --sync.loop.prune.limit=10
  • if it's not enough set --sync.loop.prune.limit=5
  • if it's not enough set WRITE_MAP=true env variable

@volare-v
Copy link
Author

volare-v commented Dec 4, 2024 •
edited
Loading

Okay, I have added the configuration --sync.loop.rune.limit=5 and restarted the node. I will run it for a week and observe the node status. Thank you very much!

@volare-v
Copy link
Author

volare-v commented Dec 4, 2024 •
edited
Loading

@AskAlexSharov

I have added the configuration "sync.loop.prune.limit" = 5 in config.toml file, then restarted the node.

But this situation still occurs:

[INFO] [12-04|10:30:32.672] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload) 
[INFO] [12-04|10:30:33.215] RPC Daemon notified of new headers       from=21328549 to=21328550 amount=1 hash=0x3005f16a3e9d5a5b68c03393c2a08e705c08c32f2567073b5dad37e092a448a7 header sending=17.226µs log sending=556ns
[INFO] [12-04|10:30:33.216] head updated                             hash=0x3005f16a3e9d5a5b68c03393c2a08e705c08c32f2567073b5dad37e092a448a7 number=21328550
[INFO] [12-04|10:31:24.915] P2P                                      app=caplin peers=60
[WARN] [12-04|10:31:49.807] [rpc] served                             conn=185.87.48.4:33676 method=eth_coinbase reqid=2 t=78.711µs err="etherbase must be explicitly specified"
[WARN] [12-04|10:31:49.867] [rpc] served                             conn=194.67.206.49:50270 method=eth_accounts reqid=2 t=49.946µs err="the method has been deprecated: eth_accounts"
[INFO] [12-04|10:32:24.916] P2P                                      app=caplin peers=66
[INFO] [12-04|10:33:24.915] P2P                                      app=caplin peers=61
[INFO] [12-04|10:33:25.207] [p2p] GoodPeers                          eth68=100 eth67=77 eth66=1
[INFO] [12-04|10:33:27.521] [mem] memory stats                       Rss=38.8GB Size=0B Pss=38.5GB SharedClean=458.3MB SharedDirty=0B PrivateClean=14.3GB PrivateDirty=24.0GB Referenced=35.9GB Anonymous=24.0GB Swap=6.5MB alloc=11.2GB sys=18.7GB
[INFO] [12-04|10:33:27.735] [txpool] stat                            pending=1656 baseFee=789 queued=584 alloc=11.2GB sys=18.7GB
[WARN] [12-04|10:33:46.206] [rpc] served                             conn=185.87.48.4:37450 method=eth_accounts reqid=2 t=64.75µs err="the method has been deprecated: eth_accounts"
[WARN] [12-04|10:33:46.975] [rpc] served                             conn=185.87.48.4:37466 method=eth_coinbase reqid=2 t=60.388µs err="etherbase must be explicitly specified"
[INFO] [12-04|10:34:24.915] P2P                                      app=caplin peers=60
[INFO] [12-04|10:34:55.313] [3/12 Senders] Started                   from=21328550 to=21328571
[INFO] [12-04|10:34:55.366] [4/12 Execution] Blocks execution        from=21328550 to=21328571
[INFO] [12-04|10:35:04.609] [4/12 Execution] Completed on            block=21328571
[INFO] [12-04|10:35:04.609] [5/12 HashState] Promoting plain state   from=21328550 to=21328571
[INFO] [12-04|10:35:04.609] [5/12 HashState] Incremental promotion   from=21328550 to=21328571 codes=true csbucket=AccountChangeSet
[INFO] [12-04|10:35:05.978] [5/12 HashState] Incremental promotion   from=21328550 to=21328571 codes=false csbucket=AccountChangeSet
[INFO] [12-04|10:35:08.787] [5/12 HashState] Incremental promotion   from=21328550 to=21328571 codes=false csbucket=StorageChangeSet
[INFO] [12-04|10:35:12.401] [6/12 IntermediateHashes] Generating intermediate hashes from=21328550 to=21328571
[INFO] [12-04|10:35:24.916] P2P                                      app=caplin peers=56
[INFO] [12-04|10:35:27.458] [7/12 CallTraces] Pruned call trace intermediate table from=21238550 to=21238570
[INFO] [12-04|10:35:45.297] RPC Daemon notified of new headers       from=21328550 to=21328571 amount=21 hash=0x3aca3ef28b8979cb95addaaa8e8147965c7774f97382bf807fdf44a507ea3049 header sending=41.625µs log sending=269ns
[INFO] [12-04|10:35:45.298] head updated                             hash=0x3aca3ef28b8979cb95addaaa8e8147965c7774f97382bf807fdf44a507ea3049 number=21328571
[WARN] [12-04|10:35:46.314] [rpc] served                             conn=194.67.206.44:55106 method=eth_accounts reqid=2 t=93.116µs err="the method has been deprecated: eth_accounts"
[WARN] [12-04|10:35:47.221] [rpc] served                             conn=194.67.206.44:55122 method=eth_coinbase reqid=2 t=82.441µs err="etherbase must be explicitly specified"
[INFO] [12-04|10:36:11.583] [4/12 Execution] Completed on            block=21328577
[INFO] [12-04|10:36:22.587] RPC Daemon notified of new headers       from=21328571 to=21328577 amount=6 hash=0xd9e8c765bacec95041324d07134476e5cb8b9376e835374d918a1d9438530585 header sending=21.36µs log sending=349ns
[INFO] [12-04|10:36:22.587] head updated                             hash=0xd9e8c765bacec95041324d07134476e5cb8b9376e835374d918a1d9438530585 number=21328577
[INFO] [12-04|10:36:24.915] P2P                                      app=caplin peers=61
[INFO] [12-04|10:36:25.207] [p2p] GoodPeers                          eth68=100 eth67=77 eth66=1
[INFO] [12-04|10:36:27.684] [mem] memory stats                       Rss=39.3GB Size=0B Pss=39.0GB SharedClean=458.3MB SharedDirty=0B PrivateClean=13.9GB PrivateDirty=24.9GB Referenced=36.4GB Anonymous=24.9GB Swap=6.5MB alloc=9.5GB sys=18.7GB
[INFO] [12-04|10:36:27.735] [txpool] stat                            pending=267 baseFee=862 queued=550 alloc=9.5GB sys=18.7GB
[INFO] [12-04|10:36:30.736] [4/12 Execution] Completed on            block=21328579
[INFO] [12-04|10:36:32.309] RPC Daemon notified of new headers       from=21328577 to=21328579 amount=2 hash=0x8148b882ab22d5b32fea8f770ae968aa639e33919f2ec3a365f0545dc991be9a header sending=16.26µs log sending=343ns
[INFO] [12-04|10:36:32.309] head updated                             hash=0x8148b882ab22d5b32fea8f770ae968aa639e33919f2ec3a365f0545dc991be9a number=21328579

@volare-v
Copy link
Author

volare-v commented Dec 4, 2024

@AskAlexSharov

How to set WRITE_MAP=true env variable?

$ export WRITE_MAP=true

$ pm2 start -n mainnet ./erigon/build/bin/erigon -- --datadir=./data --config ./config.toml

@VBulikov VBulikov added the imp2 Medium importance label Dec 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
imp2 Medium importance
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@VBulikov @AskAlexSharov @volare-v