Rusty Russell fa7d732ba6 lightningd: allow a connection to specify db batching. ...

Previous commit was a hack which *always* batched where possible, this
is a more sophisticated opt-in varaint, with a timeout sanity check.

Final performance for cleaning up 1M pays/forwards/invoices:

```
$ time l1-cli autoclean-once succeededpays 1
{
   "autoclean": {
      "succeededpays": {
         "cleaned": 1000000,
         "uncleaned": 26895
      }
   }
}

real	6m9.828s
user	0m0.003s
sys	0m0.001s
$ time l2-cli autoclean-once succeededforwards 1
{
   "autoclean": {
      "succeededforwards": {
         "cleaned": 1000000,
         "uncleaned": 40
      }
   }
}

real	3m20.789s
user	0m0.004s
sys	0m0.001s
$ time l3-cli autoclean-once paidinvoices 1
{
   "autoclean": {
      "paidinvoices": {
         "cleaned": 1000000,
         "uncleaned": 0
      }
   }
}

real	6m47.941s
user	0m0.001s
sys	0m0.000s
```

Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
Changelog-Added: JSON-RPC: `batching` command to allow database transactions to cross multiple back-to-back JSON commands.

2022-09-22 15:19:46 +02:00

..

release-notes

doc: Fixed typo in the release notes

2018-06-18 12:45:00 +02:00

schemas

lightningd: allow a connection to specify db batching.

2022-09-22 15:19:46 +02:00

.gitignore

Add documentation.

2015-07-18 10:46:53 +09:30

BACKUP.md

use 'postgres' driver (not postgresql). Include plain url to guide, as link is broken on RTD.

2022-08-22 11:21:59 -04:00

bitcoin.bib

bitcoin.bib: Add Satoshi paper URL and date

2018-03-04 03:22:32 +01:00

CHANGELOG.md

docs: Add configuration for the sphinx documentation generator

2019-02-18 02:42:29 +00:00

commit-tx.eps

Add documentation.

2015-07-18 10:46:53 +09:30

commit-tx.svg

Add documentation.

2015-07-18 10:46:53 +09:30

conf.py

doc: Update lightning.readthedocs.org project name after rebrand

2022-05-14 11:43:46 +09:30

deployable-lightning.lyx

udpate broken link

2018-06-08 17:56:48 +02:00

deployable-lightning.pdf

Regenerate PDF.

2015-11-20 06:45:19 +10:30

dual-anchor-diag1.eps

Add documentation.

2015-07-18 10:46:53 +09:30

dual-anchor-diag1.svg

Add documentation.

2015-07-18 10:46:53 +09:30

dual-anchor-diag2.eps

Add documentation.

2015-07-18 10:46:53 +09:30

dual-anchor-diag2.svg

Add documentation.

2015-07-18 10:46:53 +09:30

dual-anchor-diag3.eps

Add documentation.

2015-07-18 10:46:53 +09:30

dual-anchor-diag3.svg

Add documentation.

2015-07-18 10:46:53 +09:30

dual-anchor-diag4.eps

doc: fix flaw in escape transactions.

2015-07-20 14:07:25 +09:30

dual-anchor-diag4.svg

doc: fix flaw in escape transactions.

2015-07-20 14:07:25 +09:30

dual-anchor-final.eps

doc: fix flaw in escape transactions.

2015-07-20 14:07:25 +09:30

dual-anchor-final.svg

doc: fix flaw in escape transactions.

2015-07-20 14:07:25 +09:30

dual-anchor-take2.svg

Add documentation.

2015-07-18 10:46:53 +09:30

dual-anchor.svg

Add documentation.

2015-07-18 10:46:53 +09:30

FAQ.md

fix MD link where text and url are swapped

2022-08-22 11:21:19 -04:00

FUZZING.md

doc: add a document about our fuzz testing integration

2020-10-21 19:34:39 +02:00

HACKING.md

Change lightning-rfc to bolts post repo move

2022-05-18 10:19:16 +09:30

htlc.eps

Add documentation.

2015-07-18 10:46:53 +09:30

htlc.svg

Add documentation.

2015-07-18 10:46:53 +09:30

index.rst

lightningd: allow a connection to specify db batching.

2022-09-22 15:19:46 +02:00

INSTALL.md

Update doc/INSTALL.md

2022-09-18 14:19:16 +02:00

lightning-addgossip.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-autoclean-status.7.md

doc: manpages and schemas for autoclean-status.

2022-09-22 15:19:46 +02:00

lightning-batching.7.md

lightningd: allow a connection to specify db batching.

2022-09-22 15:19:46 +02:00

lightning-bkpr-channelsapy.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-bkpr-dumpincomecsv.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-bkpr-inspect.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-bkpr-listaccountevents.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-bkpr-listbalances.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-bkpr-listincome.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-check.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-checkmessage.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-cli.1.md

doc: format markdown correctly.

2022-09-08 00:36:51 +03:00

lightning-close.7.md

doc: Fix wrong_funding description in manpage and type in schema

2022-09-22 10:41:05 +02:00

lightning-commando-rune.7.md

commando: make rune alternatives a JSON array.

2022-09-14 17:46:43 +02:00

lightning-commando.7.md

doc: document commando and commando-rune.

2022-07-17 08:51:02 +09:30

lightning-connect.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-createinvoice.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-createonion.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-datastore.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-decode.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-decodepay.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-deldatastore.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-delexpiredinvoice.7.md

doc: manpages and schemas for autoclean-status.

2022-09-22 15:19:46 +02:00

lightning-delforward.7.md

lightningd: add delforward command.

2022-09-22 15:19:46 +02:00

lightning-delinvoice.7.md

doc: manpages and schemas for autoclean-status.

2022-09-22 15:19:46 +02:00

lightning-delpay.7.md

wallet: Load and value completed_at timestamp from DB

2022-09-14 13:14:10 +02:00

lightning-disableoffer.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-disconnect.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-emergencyrecover.7.md

doc: Add documentation for new RPCs and a FIXME: in fromschema.py

2022-07-14 12:24:48 -05:00

lightning-feerates.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-fetchinvoice.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-fundchannel_cancel.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-fundchannel_complete.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-fundchannel_start.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-fundchannel.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-funderupdate.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-fundpsbt.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-getinfo.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-getlog.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-getroute.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-help.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-hsmtool.8.md

doc: format markdown correctly.

2022-09-08 00:36:51 +03:00

lightning-invoice.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-keysend.7.md

keysend: allow extratlvs parameter, even in non-experimental mode.

2022-09-22 17:19:11 +09:30

lightning-listchannels.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-listconfigs.7.md

lightningd: allow extra tlv types in non-experimental mode.

2022-09-22 17:19:11 +09:30

lightning-listdatastore.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-listforwards.7.md

doc: manpages and schemas for autoclean-status.

2022-09-22 15:19:46 +02:00

lightning-listfunds.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-listhtlcs.7.md

lightningd: add listhtlcs to list all the HTLCs we know about.

2022-09-22 15:19:46 +02:00

lightning-listinvoices.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-listnodes.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-listoffers.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-listpays.7.md

wallet: Load and value completed_at timestamp from DB

2022-09-14 13:14:10 +02:00

lightning-listpeers.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-listsendpays.7.md

wallet: Load and value completed_at timestamp from DB

2022-09-14 13:14:10 +02:00

lightning-listtransactions.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-makesecret.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-multifundchannel.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-multiwithdraw.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-newaddr.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-notifications.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-offer.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-offerout.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-openchannel_abort.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-openchannel_bump.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-openchannel_init.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-openchannel_signed.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-openchannel_update.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-parsefeerate.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-pay.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-ping.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-plugin.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-recoverchannel.7.md

doc: Add documentation for new RPCs and a FIXME: in fromschema.py

2022-07-14 12:24:48 -05:00

lightning-reserveinputs.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-sendcustommsg.7.md

doc: disallow additional properties in sendcustommsg.

2022-09-12 14:00:41 +02:00

lightning-sendinvoice.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-sendonion.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-sendonionmessage.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-sendpay.7.md

wallet: Load and value completed_at timestamp from DB

2022-09-14 13:14:10 +02:00

lightning-sendpsbt.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-setchannel.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-setchannelfee.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-signmessage.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-signpsbt.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-staticbackup.7.md

doc: Typo

2022-08-19 10:27:09 -04:00

lightning-stop.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-txdiscard.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-txprepare.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-txsend.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-unreserveinputs.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-utxopsbt.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-waitanyinvoice.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-waitblockheight.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-waitinvoice.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightning-waitsendpay.7.md

wallet: Load and value completed_at timestamp from DB

2022-09-14 13:14:10 +02:00

lightning-withdraw.7.md

doc: escape output types (esp short_channel_id).

2022-09-12 14:00:41 +02:00

lightningd-config.5.md

autoclean: use config variables, not commands.

2022-09-22 15:19:46 +02:00

lightningd.8.md

doc: format markdown correctly.

2022-09-08 00:36:51 +03:00

ln-draft-fig1.eps

doc: add figures from LN draft (thanks Joseph!).

2015-07-20 14:07:40 +09:30

ln-draft-fig2.eps

doc: add figures from LN draft (thanks Joseph!).

2015-07-20 14:07:40 +09:30

Makefile

lightningd: allow a connection to specify db batching.

2022-09-22 15:19:46 +02:00

MAKING-RELEASES.md

Makefile: add targets to upgrade pyln versions, push releases.

2022-09-22 11:41:11 +02:00

PLUGINS.md

plugin: Add reserve to openchannel hook result

2022-09-21 11:25:47 +02:00

REPRODUCIBLE.md

doc: Spell out the reprobuild instructions for each distro

2022-07-21 15:21:12 -05:00

STYLE.md

Changelog-None

2022-08-22 11:21:19 -04:00

TOR.md

doc: mention ip discovery only active when no addresses are announced

2022-07-12 13:59:46 -05:00

undoc-flags.json

lightningd: allow extra tlv types in non-experimental mode.

2022-09-22 17:19:11 +09:30