[bug]: Force Channel Closures Failing to Resolve

[marischaldesign]

Background

Force Channel Closures Failing to Resolve

Your environment

Version: 19.2
Bitcoin Knots 28.1
Umbrel (latest)
64gb Ram
4tb NVME
10500t CPU
Uninterruptible Power Supply

Steps to reproduce

Channels just seam to be closing randomly themselves.

Expected behaviour

Channels not to close, but when they do allocate funds back to onchain wallet.

Actual behaviour

Sats are sitting in limbo and the anchor is lost

umbrel@umbrel:~/umbrel/bin$ sudo ./lncli pendingchannels

{
"total_limbo_balance": "7028598",
"pending_open_channels": [],
"pending_closing_channels": [],
"pending_force_closing_channels": [
{
"channel": {
"remote_node_pub": "033f09f5ae51c101debed97a7a7317fc5e91a2041bf9ee17079856c2d400587 2e1",
"channel_point": "a72a92fac23dd5b2810678729639cf63f0912af424cc2133387cf52c376c3811: 1",
"capacity": "2000000",
"local_balance": "44312",
"remote_balance": "1742096",
"local_chan_reserve_sat": "0",
"remote_chan_reserve_sat": "0",
"initiator": "INITIATOR_LOCAL",
"commitment_type": "ANCHORS",
"num_forwarding_packages": "0",
"chan_status_flags": "",
"private": false,
"memo": "",
"custom_channel_data": ""
},
"closing_txid": "a28ad21dc659fd9b284491e4a16665842918e5b34932965a0aa05dd67b12f108",
"limbo_balance": "44312",
"maturity_height": 912073,
"blocks_til_maturity": -943,
"recovered_balance": "0",
"pending_htlcs": [],
"anchor": "LOST"
},
{
"channel": {
"remote_node_pub": "03d32e5618df518e911e2c0bf4686e9d236ae9ab0afd442f0a5de28b74d6433 8b3",
"channel_point": "1cb13b3b6daad6ab2660910553e256b41917c5f0925c8a13e89234dd19243619: 1",
"capacity": "1000000",
"local_balance": "312835",
"remote_balance": "595860",
"local_chan_reserve_sat": "0",
"remote_chan_reserve_sat": "0",
"initiator": "INITIATOR_LOCAL",
"commitment_type": "ANCHORS",
"num_forwarding_packages": "0",
"chan_status_flags": "",
"private": false,
"memo": "",
"custom_channel_data": ""
},
"closing_txid": "0799c15efe54cd38b2641cc58003bcbca5e10292b3ad19511dab6bcea6ad4f1b",
"limbo_balance": "312835",
"maturity_height": 910396,
"blocks_til_maturity": -2620,
"recovered_balance": "0",
"pending_htlcs": [],
"anchor": "LOST"
},
{
"channel": {
"remote_node_pub": "032ae3168ba52314da581d6b6693c562b437a9cf805933d4d69e7801547e073 02e",
"channel_point": "4387b98014c203c230a02330f65731ef5823f24d78ca0f4b9c7cc1d1f214ec2b: 1",
"capacity": "2500000",
"local_balance": "30994",
"remote_balance": "2458018",
"local_chan_reserve_sat": "0",
"remote_chan_reserve_sat": "0",
"initiator": "INITIATOR_REMOTE",
"commitment_type": "ANCHORS",
"num_forwarding_packages": "0",
"chan_status_flags": "",
"private": false,
"memo": "",
"custom_channel_data": ""
},
"closing_txid": "d436d6980ada8cabda25d3a48323cb9d9e0754ce2941b6f28dba345470155d39",
"limbo_balance": "30994",
"maturity_height": 910131,
"blocks_til_maturity": -2885,
"recovered_balance": "0",
"pending_htlcs": [],
"anchor": "LOST"
},
{
"channel": {
"remote_node_pub": "02f1246b8fe904a5c5193504d8069532b1fb8692b84fb3eb64318b201238f60 ff1",
"channel_point": "902e6efd82be5e4d70a100288b57a7794650302893bf5c4eac73aa9fa3f12135: 0",
"capacity": "3500000",
"local_balance": "938077",
"remote_balance": "2550570",
"local_chan_reserve_sat": "0",
"remote_chan_reserve_sat": "0",
"initiator": "INITIATOR_LOCAL",
"commitment_type": "ANCHORS",
"num_forwarding_packages": "0",
"chan_status_flags": "",
"private": false,
"memo": "",
"custom_channel_data": ""
},
"closing_txid": "a55525573ddce02c6b3ce8ac3d4dadae981d7f9bbb7a5017ce75574fd9175461",
"limbo_balance": "938077",
"maturity_height": 910097,
"blocks_til_maturity": -2919,
"recovered_balance": "0",
"pending_htlcs": [],
"anchor": "LOST"
},
{
"channel": {
"remote_node_pub": "03f6ac15e12f2b365d08976d30b7b3298bc0bed4f29417d5cbcb32c91ccc37b 075",
"channel_point": "3a6f5230bbc95f2666064a8e3e67c5fbe3468adca5a365103841a7d07b818e55: 1",
"capacity": "1000000",
"local_balance": "120131",
"remote_balance": "868235",
"local_chan_reserve_sat": "0",
"remote_chan_reserve_sat": "0",
"initiator": "INITIATOR_LOCAL",
"commitment_type": "ANCHORS",
"num_forwarding_packages": "0",
"chan_status_flags": "",
"private": false,
"memo": "",
"custom_channel_data": ""
},
"closing_txid": "c28f347d36af31c53405aa3f899024def52d7691598de8120ab5b71205ae6f6e",
"limbo_balance": "120131",
"maturity_height": 910105,
"blocks_til_maturity": -2911,
"recovered_balance": "0",
"pending_htlcs": [],
"anchor": "LOST"
},
{
"channel": {
"remote_node_pub": "02fce3ea57e9ce97cb7da178b91ba00d194b1a4d0928325463c777622b88eab 001",
"channel_point": "6a8c6d44ba4890e51d40b444695c7a59356a42b5cfd8215c3d9fb486a871de79: 1",
"capacity": "3000000",
"local_balance": "2348516",
"remote_balance": "639850",
"local_chan_reserve_sat": "0",
"remote_chan_reserve_sat": "0",
"initiator": "INITIATOR_LOCAL",
"commitment_type": "ANCHORS",
"num_forwarding_packages": "0",
"chan_status_flags": "",
"private": false,
"memo": "",
"custom_channel_data": ""
},
"closing_txid": "413b445f4c38aa673489e544fc0a1de5e826e2d8405cd2cbb71581ecffd18afc",
"limbo_balance": "2348516",
"maturity_height": 910131,
"blocks_til_maturity": -2885,
"recovered_balance": "0",
"pending_htlcs": [],
"anchor": "LOST"
},
{
"channel": {
"remote_node_pub": "02d2451ad77976b304c8f6c591ed635b62946846feead72da9b81b550f61019 858",
"channel_point": "7f02cc5e1dbfdf19690daf18ece4fd1825cd79d7911e8e8d680e14845d682381: 0",
"capacity": "1000000",
"local_balance": "283713",
"remote_balance": "688901",
"local_chan_reserve_sat": "0",
"remote_chan_reserve_sat": "0",
"initiator": "INITIATOR_LOCAL",
"commitment_type": "ANCHORS",
"num_forwarding_packages": "0",
"chan_status_flags": "",
"private": false,
"memo": "",
"custom_channel_data": ""
},
"closing_txid": "c928a970fea1f7aac68c577756f234bdd5337d89a43c975192bba009ddcdd646",
"limbo_balance": "283713",
"maturity_height": 910094,
"blocks_til_maturity": -2922,
"recovered_balance": "0",
"pending_htlcs": [],
"anchor": "LOST"
},
{
"channel": {
"remote_node_pub": "031a01e29587952eda0ed5d10c4e79bf0fc88d61aeae89e8a7ea7c036badb8c 793",
"channel_point": "60a736f62cf80ed13bee84c2ccf7a657eea8663e33dc063e81e184effc92188a: 5",
"capacity": "2000000",
"local_balance": "20353",
"remote_balance": "1968659",
"local_chan_reserve_sat": "0",
"remote_chan_reserve_sat": "0",
"initiator": "INITIATOR_REMOTE",
"commitment_type": "ANCHORS",
"num_forwarding_packages": "0",
"chan_status_flags": "",
"private": false,
"memo": "",
"custom_channel_data": ""
},
"closing_txid": "d392d425823c79dc11dbfe69859ad45195c0040ec56fe4006cc1b5929ffd7b5c",
"limbo_balance": "20353",
"maturity_height": 912070,
"blocks_til_maturity": -946,
"recovered_balance": "0",
"pending_htlcs": [],
"anchor": "LOST"
},
{
"channel": {
"remote_node_pub": "0217ab1f3781f806c702341714d67ddd46bd2253150cc5a7a4354d2110439b5 976",
"channel_point": "054d3a1be0d05857b002e540ccc71a20470c1d6fc2f2d8ead092cbc733cc70ab: 1",
"capacity": "5000000",
"local_balance": "1893027",
"remote_balance": "1903487",
"local_chan_reserve_sat": "0",
"remote_chan_reserve_sat": "0",
"initiator": "INITIATOR_REMOTE",
"commitment_type": "ANCHORS",
"num_forwarding_packages": "0",
"chan_status_flags": "",
"private": false,
"memo": "",
"custom_channel_data": ""
},
"closing_txid": "896a2a7acba44f136337725b14c76ff0373da29fbe60086ba80386e1a75f7383",
"limbo_balance": "1893027",
"maturity_height": 910234,
"blocks_til_maturity": -2782,
"recovered_balance": "0",
"pending_htlcs": [],
"anchor": "LOST"
},
{
"channel": {
"remote_node_pub": "03d92d6fac82b1aef7c974ee400dcc64aef3ee12723a01bdc0c269edb4f11c5 924",
"channel_point": "c536aedb15a522f719448f6f19d90167f8bbcef5507e735da8490b2d3da0ccd5: 1",
"capacity": "2100000",
"local_balance": "1036640",
"remote_balance": "1062363",
"local_chan_reserve_sat": "0",
"remote_chan_reserve_sat": "0",
"initiator": "INITIATOR_REMOTE",
"commitment_type": "ANCHORS",
"num_forwarding_packages": "0",
"chan_status_flags": "",
"private": false,
"memo": "",
"custom_channel_data": ""
},
"closing_txid": "0c0407828868dd0478553e3cd7a648c19e5bdbe35c5e9a10d60b77349ba2f9ac",
"limbo_balance": "1036640",
"maturity_height": 913122,
"blocks_til_maturity": 106,
"recovered_balance": "0",
"pending_htlcs": [],
"anchor": "LOST"
}
],
"waiting_close_channels": []

[bitromortac]

This should be solved with v0.19.3, please try to update.

[marischaldesign]

Thank you for response.

Will it resolve automatically when updated to 19.3?

[bitromortac]

Yes, outputs should be swept automatically.

[shuishihang]

Will the issue of forcibly closed asset channels also be resolved? I’ve updated, but the forcibly closed asset channels still haven’t been properly closed.

[bitromortac]

I didn't see any custom channel related pending channels. Could you post outputs for that? There is still a known issue for asset sweeps, where a fix is being worked on see lightninglabs/lightning-terminal#1139.

[shuishihang]

closedchannel.txt

[bitromortac]

Thank you. Could you provide startup logs with this configuration option set to debuglevel=SWPR=debug,CNCT=debug,BTCN=debug,NTFN=debug,LNWL=debug,CHNF=debug?

[Roasbeef]

Bitcoin Knots 28.1

Can you share your config? The default config of Knots has settings that can cause critical transactions to otherwise not relay or be accepted.

[marischaldesign]

Has resolved with latest lnd update.