]> Sergey Matveev's repositories - public-inbox.git/commit
lei up: automatically use dt: for remote externals
authorEric Wong <e@80x24.org>
Sat, 18 Sep 2021 09:33:32 +0000 (09:33 +0000)
committerEric Wong <e@80x24.org>
Sat, 18 Sep 2021 20:28:16 +0000 (20:28 +0000)
commitf3d0e746c6a35c8600b91af99958a52cbc114a4b
tree77d4a48575562c953f4bb1de8c1455fa749391b9
parent9d54d6260497a2a08bdefd25f02e817ad6505264
lei up: automatically use dt: for remote externals

Since we can't use maxuid for remote externals, automatically
maintaining the last time we got results and appending a dt:
range to the query will prevent HTTP(S) responses from getting
too big.

We could be using "rt:", but no stable release of public-inbox
supports it, yet, so we'll use dt:, instead.

By default, there's a two day fudge factor to account for MTA
downtime and delays; which is hopefully enough.  The fudge
factor may be changed per-invocation with the
--remote-fudge-factor=INTERVAL option

Since different externals can have different message transport
routes, "lastresult" entries are stored on a per-external basis.
Documentation/lei-up.pod
lib/PublicInbox/LEI.pm
lib/PublicInbox/LeiSavedSearch.pm
lib/PublicInbox/LeiToMail.pm
lib/PublicInbox/LeiUp.pm
lib/PublicInbox/LeiXSearch.pm
t/lei-q-remote-import.t