]> Sergey Matveev's repositories - public-inbox.git/commit
extindex: dedupe: reduce SQLite contention and dirty data
authorEric Wong <e@80x24.org>
Thu, 8 Jul 2021 08:25:19 +0000 (08:25 +0000)
committerEric Wong <e@80x24.org>
Thu, 8 Jul 2021 08:32:43 +0000 (08:32 +0000)
commitb5c380e01ba5106ceeb7159594830157e569e62b
treeeae957c4db6ca9e1ef5ff00523e1c42a4aba3f31
parent3b9157689728eb396891cc32f3fdc038562b7f3d
extindex: dedupe: reduce SQLite contention and dirty data

Complex queries causes SQLite to block readers for longer than
their retry period.  For dedupe, it was also preventing us from
making good use of checkpoints due to the query time.

With many deduplications, checkpoints are necessary to maintain
system health due to having too much data piled up.
lib/PublicInbox/ExtSearchIdx.pm