Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: Intermittent RTL Panel Access Issues with BTCPayServer v1.12.5 #5838

Open
1 task done
TowyTowy opened this issue Mar 14, 2024 · 3 comments
Open
1 task done

[Bug]: Intermittent RTL Panel Access Issues with BTCPayServer v1.12.5 #5838

TowyTowy opened this issue Mar 14, 2024 · 3 comments
Labels
Lightning Issues related to Lightning Network need-info Requires more information

Comments

@TowyTowy
Copy link

What is your BTCPay version?

I'm running BTCPay Server v1.12.5+a86165ac0

How did you deploy BTCPay Server?

I'm running BTCPayServer through Docker

What happened?

Approximately every 12 hours, I lose access to my Ride The Lightning (RTL) panel on BTCPayServer. Despite seeking assistance multiple times, a lasting resolution has not been found. I discovered that restarting the lightning-rest service temporarily resolves the issue, granting access again, but only for another 12 hours before the problem recurs.

How did you encounter this bug?

  1. Initial Observation: I noticed that the RTL panel was not accessible, which initially seemed like an isolated incident.
  2. Repeated Attempts: Attempting to access the RTL panel multiple times resulted in consistent failure, indicating a recurring issue.
  3. Seeking Assistance: I sought help through community forums and support channels but did not find a lasting solution.
  4. Discovering a Temporary Fix: Through trial and error, I discovered that restarting the lightning-rest service temporarily allowed access to the RTL panel.
  5. Pattern Recognition: I observed a pattern where, after approximately 12 hours following each restart of the lightning-rest service, access to the RTL panel would be lost again, necessitating another restart.
  6. Documentation and Reporting: After confirming this pattern over several cycles, I documented the issue in detail, including the temporary workaround, and sought to report it for a more permanent solution.

Relevant log output

These are the lightning rest logs.

ubuntu@towyswed:~$ sudo docker logs e1b1b52fab9e
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
error: Lightning client connection error
node:events:491
      throw er; // Unhandled 'error' event
      ^

Error: connect ECONNREFUSED /root/.lightning/lightning-rpc
    at PipeConnectWrap.afterConnect [as oncomplete] (node:net:1278:16)
Emitted 'error' event on LightningClient instance at:
    at Socket.<anonymous> (/usr/src/app/lightning-client-js.js:80:23)
    at Socket.emit (node:events:513:28)
    at emitErrorNT (node:internal/streams/destroy:157:8)
    at emitErrorCloseNT (node:internal/streams/destroy:122:3)
    at processTicksAndRejections (node:internal/process/task_queues:83:21) {
  errno: -111,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '/root/.lightning/lightning-rpc'
}
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
error: Lightning client connection error
node:events:491
      throw er; // Unhandled 'error' event
      ^

Error: connect ECONNREFUSED /root/.lightning/lightning-rpc
    at PipeConnectWrap.afterConnect [as oncomplete] (node:net:1278:16)
Emitted 'error' event on LightningClient instance at:
    at Socket.<anonymous> (/usr/src/app/lightning-client-js.js:80:23)
    at Socket.emit (node:events:513:28)
    at emitErrorNT (node:internal/streams/destroy:157:8)
    at emitErrorCloseNT (node:internal/streams/destroy:122:3)
    at processTicksAndRejections (node:internal/process/task_queues:83:21) {
  errno: -111,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '/root/.lightning/lightning-rpc'
}
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
error: Lightning client connection error
node:events:491
      throw er; // Unhandled 'error' event
      ^

Error: connect ECONNREFUSED /root/.lightning/lightning-rpc
    at PipeConnectWrap.afterConnect [as oncomplete] (node:net:1278:16)
Emitted 'error' event on LightningClient instance at:
    at Socket.<anonymous> (/usr/src/app/lightning-client-js.js:80:23)
    at Socket.emit (node:events:513:28)
    at emitErrorNT (node:internal/streams/destroy:157:8)
    at emitErrorCloseNT (node:internal/streams/destroy:122:3)
    at processTicksAndRejections (node:internal/process/task_queues:83:21) {
  errno: -111,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '/root/.lightning/lightning-rpc'
}
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
error: Lightning client connection error
node:events:491
      throw er; // Unhandled 'error' event
      ^

Error: connect ECONNREFUSED /root/.lightning/lightning-rpc
    at PipeConnectWrap.afterConnect [as oncomplete] (node:net:1278:16)
Emitted 'error' event on LightningClient instance at:
    at Socket.<anonymous> (/usr/src/app/lightning-client-js.js:80:23)
    at Socket.emit (node:events:513:28)
    at emitErrorNT (node:internal/streams/destroy:157:8)
    at emitErrorCloseNT (node:internal/streams/destroy:122:3)
    at processTicksAndRejections (node:internal/process/task_queues:83:21) {
  errno: -111,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '/root/.lightning/lightning-rpc'
}
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
error: Lightning client connection error
node:events:491
      throw er; // Unhandled 'error' event
      ^

Error: connect ECONNREFUSED /root/.lightning/lightning-rpc
    at PipeConnectWrap.afterConnect [as oncomplete] (node:net:1278:16)
Emitted 'error' event on LightningClient instance at:
    at Socket.<anonymous> (/usr/src/app/lightning-client-js.js:80:23)
    at Socket.emit (node:events:513:28)
    at emitErrorNT (node:internal/streams/destroy:157:8)
    at emitErrorCloseNT (node:internal/streams/destroy:122:3)
    at processTicksAndRejections (node:internal/process/task_queues:83:21) {
  errno: -111,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '/root/.lightning/lightning-rpc'
}
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
error: Lightning client connection error
node:events:491
      throw er; // Unhandled 'error' event
      ^

Error: connect ECONNREFUSED /root/.lightning/lightning-rpc
    at PipeConnectWrap.afterConnect [as oncomplete] (node:net:1278:16)
Emitted 'error' event on LightningClient instance at:
    at Socket.<anonymous> (/usr/src/app/lightning-client-js.js:80:23)
    at Socket.emit (node:events:513:28)
    at emitErrorNT (node:internal/streams/destroy:157:8)
    at emitErrorCloseNT (node:internal/streams/destroy:122:3)
    at processTicksAndRejections (node:internal/process/task_queues:83:21) {
  errno: -111,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '/root/.lightning/lightning-rpc'
}
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
error: Lightning client connection error
node:events:491
      throw er; // Unhandled 'error' event
      ^

Error: connect ECONNREFUSED /root/.lightning/lightning-rpc
    at PipeConnectWrap.afterConnect [as oncomplete] (node:net:1278:16)
Emitted 'error' event on LightningClient instance at:
    at Socket.<anonymous> (/usr/src/app/lightning-client-js.js:80:23)
    at Socket.emit (node:events:513:28)
    at emitErrorNT (node:internal/streams/destroy:157:8)
    at emitErrorCloseNT (node:internal/streams/destroy:122:3)
    at processTicksAndRejections (node:internal/process/task_queues:83:21) {
  errno: -111,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '/root/.lightning/lightning-rpc'
}
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
error: Lightning client connection error
node:events:491
      throw er; // Unhandled 'error' event
      ^

Error: connect ECONNREFUSED /root/.lightning/lightning-rpc
    at PipeConnectWrap.afterConnect [as oncomplete] (node:net:1278:16)
Emitted 'error' event on LightningClient instance at:
    at Socket.<anonymous> (/usr/src/app/lightning-client-js.js:80:23)
    at Socket.emit (node:events:513:28)
    at emitErrorNT (node:internal/streams/destroy:157:8)
    at emitErrorCloseNT (node:internal/streams/destroy:122:3)
    at processTicksAndRejections (node:internal/process/task_queues:83:21) {
  errno: -111,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '/root/.lightning/lightning-rpc'
}
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
warn: Client disconnected, total clients: 0
warn: Client disconnected, total clients: 0
warn: Client disconnected, total clients: 0
warn: {"type":"lightning","name":"LightningError","message":"failed: WIRE_UNKNOWN_NEXT_PEER (reply from remote)","code":204,"id":2363,"failcode":16394,"failcodename":"WIRE_UNKNOWN_NEXT_PEER","bolt11":"lnbc1pj7mnmapp532ktgwdx838mhetu2mwfjp3s5hkg3aq75n4el5uuwvzrqhyvt4mscqpjsp5ypty8kc0wxwsyd70s9ppa774j2greyhp4xtyz29p39vfhfaav0uq9q7sqqqqqqqqqqqqqqqqqqqsqqqqqysgqdqqmqz9gxqyjw5qrzjqwryaup9lh50kkranzgcdnn2fgvx390wgj5jd07rwr3vxeje0glcllmpua4z2zsm6cqqqqlgqqqqqeqqjqrjegj48gcs39j8rumy55xqcnx944xap4n2tqm3ghudvhutdqjemy5h8le0g4e67mkaf4cd4z5umukqc87h9xwp8nfn9wmjmx0psy6qcpnn5f2d","raw_message":"400a","created_at":1710083973,"destination":"038dce0fd64147d9646aa78f03ba23fc2d77672d778e493be5d461e76a250a1bd6","payment_hash":"8aacb439a63c4fbbe57c56dc990630a5ec88f41ea4eb9fd39c7304305c8c5d77","status":"failed","amount_msat":300000000,"amount_sent_msat":0,"erring_index":2,"erring_node":"03864ef025fde8fb587d989186ce6a4a186895ee44a926bfc370e2c366597a3f8f","erring_channel":"16736743x6956298x7126","erring_direction":0,"fullType":"lightning"}
warn: {"type":"lightning","name":"LightningError","message":"failed: WIRE_UNKNOWN_NEXT_PEER (reply from remote)","code":204,"id":2377,"failcode":16394,"failcodename":"WIRE_UNKNOWN_NEXT_PEER","bolt11":"lnbc1pj7mnmapp532ktgwdx838mhetu2mwfjp3s5hkg3aq75n4el5uuwvzrqhyvt4mscqpjsp5ypty8kc0wxwsyd70s9ppa774j2greyhp4xtyz29p39vfhfaav0uq9q7sqqqqqqqqqqqqqqqqqqqsqqqqqysgqdqqmqz9gxqyjw5qrzjqwryaup9lh50kkranzgcdnn2fgvx390wgj5jd07rwr3vxeje0glcllmpua4z2zsm6cqqqqlgqqqqqeqqjqrjegj48gcs39j8rumy55xqcnx944xap4n2tqm3ghudvhutdqjemy5h8le0g4e67mkaf4cd4z5umukqc87h9xwp8nfn9wmjmx0psy6qcpnn5f2d","raw_message":"400a","created_at":1710084073,"destination":"038dce0fd64147d9646aa78f03ba23fc2d77672d778e493be5d461e76a250a1bd6","payment_hash":"8aacb439a63c4fbbe57c56dc990630a5ec88f41ea4eb9fd39c7304305c8c5d77","status":"failed","amount_msat":250000000,"amount_sent_msat":0,"erring_index":2,"erring_node":"03864ef025fde8fb587d989186ce6a4a186895ee44a926bfc370e2c366597a3f8f","erring_channel":"16736743x6956298x7126","erring_direction":0,"fullType":"lightning"}
warn: Client disconnected, total clients: 0
warn: Client disconnected, total clients: 0
Lightning client connection closed
warn: Client disconnected, total clients: 0
warn: Client disconnected, total clients: 0
warn: Client disconnected, total clients: 0
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
warn: Client disconnected, total clients: 0
warn: Client disconnected, total clients: 0
warn: {"type":"lightning","name":"LightningError","message":"Ran out of routes to try after 52 attempts: see `paystatus`","code":210,"attempts":[{"status":"failed","partid":0,"amount_msat":50000000}],"fullType":"lightning"}
warn: {"type":"lightning","name":"LightningError","message":"Ran out of routes to try after 52 attempts: see `paystatus`","code":210,"attempts":[{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":0,"amount_msat":100000000},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":1,"amount_msat":100000000,"parent_partid":0},{"status":"pending","failreason":"Fee exceeds our fee budget: 714880msat > 500000msat, discarding route","partid":2,"amount_msat":100000000,"parent_partid":1},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":3,"amount_msat":48834077,"parent_partid":2},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":12,"amount_msat":48834077,"parent_partid":3},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":16,"amount_msat":48834077,"parent_partid":12},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":21,"amount_msat":48834077,"parent_partid":16},{"status":"pending","failreason":"No path found","partid":35,"amount_msat":48834077,"parent_partid":21},{"status":"pending","failreason":"No path found","partid":36,"amount_msat":23233134,"parent_partid":35},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":38,"amount_msat":10457934,"parent_partid":36},{"status":"pending","failreason":"No path found","partid":39,"amount_msat":12775200,"parent_partid":36},{"status":"pending","failreason":"No path found","partid":42,"amount_msat":6644924,"parent_partid":39},{"status":"failed","failreason":"No path found","partid":50,"amount_msat":3240068,"parent_partid":42},{"status":"failed","failreason":"No path found","partid":51,"amount_msat":3404856,"parent_partid":42},{"status":"pending","failreason":"No path found","partid":43,"amount_msat":6130276,"parent_partid":39},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":46,"amount_msat":2900086,"parent_partid":43},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":47,"amount_msat":3230190,"parent_partid":43},{"status":"pending","failreason":"No path found","partid":37,"amount_msat":25600943,"parent_partid":35},{"status":"pending","failreason":"No path found","partid":40,"amount_msat":12731283,"parent_partid":37},{"status":"failed","failreason":"No path found","partid":48,"amount_msat":5737735,"parent_partid":40},{"status":"failed","failreason":"No path found","partid":49,"amount_msat":6993548,"parent_partid":40},{"status":"pending","failreason":"No path found","partid":41,"amount_msat":12869660,"parent_partid":37},{"status":"failed","failreason":"Cannot split payment any further without exceeding the maximum number of HTLCs allowed by our channels","partid":44,"amount_msat":6995219,"parent_partid":41},{"status":"failed","failreason":"No path found","partid":45,"amount_msat":5874441,"parent_partid":41},{"status":"pending","failreason":"Fee exceeds our fee budget: 213906msat > 52086msat, discarding route","partid":4,"amount_msat":51165923,"parent_partid":2},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":5,"amount_msat":23335998,"parent_partid":4},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":14,"amount_msat":23335998,"parent_partid":5},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":20,"amount_msat":23335998,"parent_partid":14},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":30,"amount_msat":23335998,"parent_partid":20},{"status":"pending","failreason":"Fee exceeds our fee budget: 28947msat > 26506msat, discarding route","partid":6,"amount_msat":27829925,"parent_partid":4},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":7,"amount_msat":13717881,"parent_partid":6},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":11,"amount_msat":13717881,"parent_partid":7},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":17,"amount_msat":13717881,"parent_partid":11},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":22,"amount_msat":13717881,"parent_partid":17},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":32,"amount_msat":13717881,"parent_partid":22},{"status":"pending","failreason":"Fee exceeds our fee budget: 14551msat > 11467msat, discarding route","partid":8,"amount_msat":14112044,"parent_partid":6},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":9,"amount_msat":6374181,"parent_partid":8},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":13,"amount_msat":6374181,"parent_partid":9},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":18,"amount_msat":6374181,"parent_partid":13},{"status":"pending","failreason":"Fee exceeds our fee budget: 38945msat > 31871msat, discarding route","partid":23,"amount_msat":6374181,"parent_partid":18},{"status":"pending","failreason":"Fee exceeds our fee budget: 15852msat > 15176msat, discarding route","partid":24,"amount_msat":3035321,"parent_partid":23},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":26,"amount_msat":1486820,"parent_partid":24},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":34,"amount_msat":1486820,"parent_partid":26},{"status":"pending","failreason":"Fee exceeds our fee budget: 13168msat > 7743msat, discarding route","partid":27,"amount_msat":1548501,"parent_partid":24},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":28,"amount_msat":823775,"parent_partid":27},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":29,"amount_msat":724726,"parent_partid":27},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":25,"amount_msat":3338860,"parent_partid":23},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":33,"amount_msat":3338860,"parent_partid":25},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":10,"amount_msat":7737863,"parent_partid":8},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":15,"amount_msat":7737863,"parent_partid":10},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":19,"amount_msat":7737863,"parent_partid":15},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":31,"amount_msat":7737863,"parent_partid":19}],"fullType":"lightning"}
warn: Client disconnected, total clients: 0
warn: Client disconnected, total clients: 0
warn: {"type":"lightning","name":"LightningError","message":"Ran out of routes to try after 40 attempts: see `paystatus`","code":210,"attempts":[{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":0,"amount_msat":50000000},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":1,"amount_msat":50000000,"parent_partid":0},{"status":"pending","failreason":"Fee exceeds our fee budget: 359194msat > 250000msat, discarding route","partid":2,"amount_msat":50000000,"parent_partid":1},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":3,"amount_msat":23566505,"parent_partid":2},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":16,"amount_msat":23566505,"parent_partid":3},{"status":"pending","failreason":"Fee exceeds our fee budget: 112444msat > 24975msat, discarding route","partid":4,"amount_msat":26433495,"parent_partid":2},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":5,"amount_msat":13044845,"parent_partid":4},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":18,"amount_msat":13044845,"parent_partid":5},{"status":"pending","failreason":"Fee exceeds our fee budget: 20153msat > 10676msat, discarding route","partid":6,"amount_msat":13388650,"parent_partid":4},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":7,"amount_msat":7024728,"parent_partid":6},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":15,"amount_msat":7024728,"parent_partid":7},{"status":"pending","failreason":"Fee exceeds our fee budget: 15874msat > 2974msat, discarding route","partid":8,"amount_msat":6363922,"parent_partid":6},{"status":"pending","failreason":"Fee exceeds our fee budget: 17176msat > 16872msat, discarding route","partid":9,"amount_msat":3374472,"parent_partid":8},{"status":"pending","failreason":"Fee exceeds our fee budget: 13029msat > 1238msat, discarding route","partid":11,"amount_msat":1691049,"parent_partid":9},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":13,"amount_msat":812671,"parent_partid":11},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":14,"amount_msat":878378,"parent_partid":11},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":12,"amount_msat":1683423,"parent_partid":9},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":19,"amount_msat":1683423,"parent_partid":12},{"status":"pending","failreason":"Unknown destination 038dce0fd64147d9646aa78f03ba23fc2d77672d778e493be5d461e76a250a1bd6","partid":20,"amount_msat":1683423,"parent_partid":19},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":21,"amount_msat":888555,"parent_partid":20},{"status":"pending","failreason":"Unknown destination 038dce0fd64147d9646aa78f03ba23fc2d77672d778e493be5d461e76a250a1bd6","partid":35,"amount_msat":888555,"parent_partid":21},{"status":"pending","failreason":"Unknown destination 038dce0fd64147d9646aa78f03ba23fc2d77672d778e493be5d461e76a250a1bd6","partid":36,"amount_msat":403426,"parent_partid":35},{"status":"failed","failreason":"No path found","partid":38,"amount_msat":191021,"parent_partid":36},{"status":"failed","failreason":"No path found","partid":39,"amount_msat":212405,"parent_partid":36},{"status":"failed","failreason":"Cannot split payment any further without exceeding the maximum number of HTLCs allowed by our channels","partid":37,"amount_msat":485129,"parent_partid":35},{"status":"pending","failreason":"Fee exceeds our fee budget: 1476msat > 1023msat, discarding route","partid":22,"amount_msat":794868,"parent_partid":20},{"status":"pending","failreason":"Unknown destination 038dce0fd64147d9646aa78f03ba23fc2d77672d778e493be5d461e76a250a1bd6","partid":23,"amount_msat":401106,"parent_partid":22},{"status":"pending","failreason":"Fee exceeds our fee budget: 3406msat > 1064msat, discarding route","partid":25,"amount_msat":212974,"parent_partid":23},{"status":"pending","failreason":"Fee exceeds our fee budget: 1062msat > 515msat, discarding route","partid":27,"amount_msat":103220,"parent_partid":25},{"status":"failed","failreason":"No path found","partid":31,"amount_msat":50698,"parent_partid":27},{"status":"failed","failreason":"No path found","partid":32,"amount_msat":52522,"parent_partid":27},{"status":"pending","failreason":"Fee exceeds our fee budget: 1657msat > 549msat, discarding route","partid":28,"amount_msat":109754,"parent_partid":25},{"status":"failed","failreason":"No path found","partid":33,"amount_msat":55114,"parent_partid":28},{"status":"failed","failreason":"No path found","partid":34,"amount_msat":54640,"parent_partid":28},{"status":"pending","failreason":"Fee exceeds our fee budget: 3170msat > 941msat, discarding route","partid":26,"amount_msat":188132,"parent_partid":23},{"status":"failed","failreason":"No path found","partid":29,"amount_msat":93664,"parent_partid":26},{"status":"failed","failreason":"No path found","partid":30,"amount_msat":94468,"parent_partid":26},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":24,"amount_msat":393762,"parent_partid":22},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":10,"amount_msat":2989450,"parent_partid":8},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":17,"amount_msat":2989450,"parent_partid":10}],"fullType":"lightning"}
warn: Client disconnected, total clients: 0
warn: {"type":"lightning","name":"LightningError","message":"Ran out of routes to try after 53 attempts: see `paystatus`","code":210,"attempts":[{"status":"failed","partid":0,"amount_msat":1500000}],"fullType":"lightning"}
warn: {"type":"lightning","name":"LightningError","message":"Ran out of routes to try after 53 attempts: see `paystatus`","code":210,"attempts":[{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":0,"amount_msat":100000000},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":1,"amount_msat":100000000,"parent_partid":0},{"status":"pending","failreason":"Fee exceeds our fee budget: 714880msat > 500000msat, discarding route","partid":2,"amount_msat":100000000,"parent_partid":1},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":3,"amount_msat":47351212,"parent_partid":2},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":8,"amount_msat":47351212,"parent_partid":3},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":11,"amount_msat":47351212,"parent_partid":8},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":13,"amount_msat":47351212,"parent_partid":11},{"status":"pending","failreason":"Fee exceeds our fee budget: 260610msat > 236756msat, discarding route","partid":17,"amount_msat":47351212,"parent_partid":13},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":19,"amount_msat":25143263,"parent_partid":17},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":23,"amount_msat":25143263,"parent_partid":19},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":30,"amount_msat":25143263,"parent_partid":23},{"status":"pending","failreason":"Fee exceeds our fee budget: 141499msat > 125716msat, discarding route","partid":33,"amount_msat":25143263,"parent_partid":30},{"status":"pending","failreason":"Fee exceeds our fee budget: 47426msat > 46903msat, discarding route","partid":37,"amount_msat":12250101,"parent_partid":33},{"status":"pending","failreason":"Fee exceeds our fee budget: 13645msat > 11822msat, discarding route","partid":39,"amount_msat":5880759,"parent_partid":37},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":41,"amount_msat":3081142,"parent_partid":39},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":42,"amount_msat":2799617,"parent_partid":39},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":40,"amount_msat":6369342,"parent_partid":37},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":44,"amount_msat":6369342,"parent_partid":40},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":38,"amount_msat":12893162,"parent_partid":33},{"status":"pending","failreason":"No path found","partid":47,"amount_msat":12893162,"parent_partid":38},{"status":"failed","failreason":"No path found","partid":49,"amount_msat":6607097,"parent_partid":47},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (WIRE_TEMPORARY_CHANNEL_FAILURE: Capacity exceeded - HTLC fee: 4566sat)","partid":50,"amount_msat":6286065,"parent_partid":47},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":20,"amount_msat":22207949,"parent_partid":17},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":24,"amount_msat":22207949,"parent_partid":20},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":29,"amount_msat":22207949,"parent_partid":24},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":36,"amount_msat":22207949,"parent_partid":29},{"status":"pending","failreason":"No path found","partid":48,"amount_msat":22207949,"parent_partid":36},{"status":"failed","failreason":"No path found","partid":51,"amount_msat":11912495,"parent_partid":48},{"status":"failed","failreason":"No path found","partid":52,"amount_msat":10295454,"parent_partid":48},{"status":"pending","failreason":"Fee exceeds our fee budget: 219989msat > 53712msat, discarding route","partid":4,"amount_msat":52648788,"parent_partid":2},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":5,"amount_msat":28666426,"parent_partid":4},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":7,"amount_msat":28666426,"parent_partid":5},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":10,"amount_msat":28666426,"parent_partid":7},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":14,"amount_msat":28666426,"parent_partid":10},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":16,"amount_msat":28666426,"parent_partid":14},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":21,"amount_msat":28666426,"parent_partid":16},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":27,"amount_msat":28666426,"parent_partid":21},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":32,"amount_msat":28666426,"parent_partid":27},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":43,"amount_msat":28666426,"parent_partid":32},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":6,"amount_msat":23982362,"parent_partid":4},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":9,"amount_msat":23982362,"parent_partid":6},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":12,"amount_msat":23982362,"parent_partid":9},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":15,"amount_msat":23982362,"parent_partid":12},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":18,"amount_msat":23982362,"parent_partid":15},{"status":"pending","failreason":"Fee exceeds our fee budget: 456304msat > 119912msat, discarding route","partid":22,"amount_msat":23982362,"parent_partid":18},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":25,"amount_msat":12070119,"parent_partid":22},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":28,"amount_msat":12070119,"parent_partid":25},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":35,"amount_msat":12070119,"parent_partid":28},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":46,"amount_msat":12070119,"parent_partid":35},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":26,"amount_msat":11912243,"parent_partid":22},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":31,"amount_msat":11912243,"parent_partid":26},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":34,"amount_msat":11912243,"parent_partid":31},{"status":"failed","failreason":"failed: WIRE_MPP_TIMEOUT (reply from remote)","partid":45,"amount_msat":11912243,"parent_partid":34}],"fullType":"lightning"}
warn: Client disconnected, total clients: 0
warn: {"type":"lightning","name":"LightningError","message":"Ran out of routes to try after 23 attempts: see `paystatus`","code":210,"attempts":[{"status":"pending","failreason":"Fee exceeds our fee budget: 7126msat > 5000msat, discarding route","partid":0,"amount_msat":800000},{"status":"pending","failreason":"Fee exceeds our fee budget: 4782msat > 2567msat, discarding route","partid":1,"amount_msat":410877,"parent_partid":0},{"status":"pending","failreason":"Fee exceeds our fee budget: 5310msat > 1268msat, discarding route","partid":3,"amount_msat":203062,"parent_partid":1},{"status":"failed","failreason":"No path found","partid":11,"amount_msat":94995,"parent_partid":3},{"status":"pending","failreason":"Fee exceeds our fee budget: 12064msat > 675msat, discarding route","partid":12,"amount_msat":108067,"parent_partid":3},{"status":"failed","failreason":"No path found","partid":17,"amount_msat":52082,"parent_partid":12},{"status":"failed","failreason":"No path found","partid":18,"amount_msat":55985,"parent_partid":12},{"status":"pending","failreason":"Fee exceeds our fee budget: 4855msat > 1299msat, discarding route","partid":4,"amount_msat":207815,"parent_partid":1},{"status":"pending","failreason":"Fee exceeds our fee budget: 1064msat > 673msat, discarding route","partid":13,"amount_msat":107704,"parent_partid":4},{"status":"failed","failreason":"No path found","partid":19,"amount_msat":49066,"parent_partid":13},{"status":"failed","failreason":"No path found","partid":20,"amount_msat":58638,"parent_partid":13},{"status":"failed","failreason":"No path found","partid":14,"amount_msat":100111,"parent_partid":4},{"status":"pending","failreason":"Fee exceeds our fee budget: 5301msat > 2433msat, discarding route","partid":2,"amount_msat":389123,"parent_partid":0},{"status":"pending","failreason":"Fee exceeds our fee budget: 3384msat > 1258msat, discarding route","partid":5,"amount_msat":201309,"parent_partid":2},{"status":"failed","failreason":"Fee exceeds our fee budget: 1058msat > 607msat, discarding route","partid":7,"amount_msat":97164,"parent_partid":5},{"status":"pending","failreason":"Fee exceeds our fee budget: 1655msat > 651msat, discarding route","partid":8,"amount_msat":104145,"parent_partid":5},{"status":"failed","failreason":"No path found","partid":21,"amount_msat":54282,"parent_partid":8},{"status":"failed","failreason":"No path found","partid":22,"amount_msat":49863,"parent_partid":8},{"status":"pending","failreason":"Fee exceeds our fee budget: 3169msat > 1175msat, discarding route","partid":6,"amount_msat":187814,"parent_partid":2},{"status":"failed","failreason":"Fee exceeds our fee budget: 12051msat > 543msat, discarding route","partid":9,"amount_msat":86904,"parent_partid":6},{"status":"pending","failreason":"Fee exceeds our fee budget: 12060msat > 632msat, discarding route","partid":10,"amount_msat":100910,"parent_partid":6},{"status":"failed","failreason":"No path found","partid":15,"amount_msat":52720,"parent_partid":10},{"status":"failed","failreason":"No path found","partid":16,"amount_msat":48190,"parent_partid":10}],"fullType":"lightning"}
warn: {"type":"lightning","name":"LightningError","message":"Ran out of routes to try after 3 attempts: see `paystatus`","code":210,"attempts":[{"status":"failed","failreason":"Fee exceeds our fee budget: 2544393msat > 2500000msat, discarding route","partid":0,"amount_msat":500000000},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":1,"amount_msat":500000000,"parent_partid":0},{"status":"failed","failreason":"No path found","partid":2,"amount_msat":500000000,"parent_partid":1}],"fullType":"lightning"}
warn: {"type":"lightning","name":"LightningError","message":"Ran out of routes to try after 3 attempts: see `paystatus`","code":210,"attempts":[{"status":"failed","failreason":"Fee exceeds our fee budget: 1273746msat > 1250000msat, discarding route","partid":0,"amount_msat":250000000},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":1,"amount_msat":250000000,"parent_partid":0},{"status":"failed","failreason":"Fee exceeds our fee budget: 13656819msat > 1250000msat, discarding route","partid":2,"amount_msat":250000000,"parent_partid":1}],"fullType":"lightning"}
warn: {"type":"lightning","name":"LightningError","message":"Ran out of routes to try after 3 attempts: see `paystatus`","code":210,"attempts":[{"status":"failed","failreason":"Fee exceeds our fee budget: 1273746msat > 1250000msat, discarding route","partid":0,"amount_msat":250000000},{"status":"failed","failreason":"failed: WIRE_TEMPORARY_CHANNEL_FAILURE (reply from remote)","partid":1,"amount_msat":250000000,"parent_partid":0},{"status":"failed","failreason":"Fee exceeds our fee budget: 13656819msat > 1250000msat, discarding route","partid":2,"amount_msat":250000000,"parent_partid":1}],"fullType":"lightning"}
warn: Client disconnected, total clients: 0
warn: Client disconnected, total clients: 0
Lightning client connection closed
warn: Client disconnected, total clients: 0
Waiting /root/.nbxplorer/btc_fully_synched to be created...
The chain is fully synched
Reading config file
warn: --- Starting the cl-rest server ---
warn: --- cl-rest api server is ready and listening on 0.0.0.0:3001 ---
warn: --- cl-rest doc server is ready and listening on 0.0.0.0:4001 ---
warn: Client disconnected, total clients: 0
ubuntu@towyswed:~$

What browser do you use?

Arc Browser (Chromium)

Additional information

No response

Are you sure this is a bug report?

  • I confirm this is a bug report
@pavlenex
Copy link
Contributor

@dennisreimann Do you know if this is something we can do by updating RTL, or should this be transferred to their repo? I just don't know if it's something we can fix.

@dennisreimann
Copy link
Member

This looks like it is most likely related to ElementsProject/lightning#4822, which was opened after prior investigation by @NicolasDorier.

@pavlenex pavlenex added Lightning Issues related to Lightning Network need-info Requires more information labels Mar 15, 2024
@TowyTowy
Copy link
Author

This looks like it is most likely related to ElementsProject/lightning#4822, which was opened after prior investigation by @NicolasDorier.

I'm not using any lightning plugins.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Lightning Issues related to Lightning Network need-info Requires more information
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@dennisreimann @pavlenex @TowyTowy