]> Sergey Matveev's repositories - public-inbox.git/commit
projects / public-inbox.git / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 8096f95) | patch
v2writable: support async git blob retrievals
authorEric Wong <e@yhbt.net>
Sat, 25 Jul 2020 21:12:21 +0000 (21:12 +0000)
committerEric Wong <e@yhbt.net>
Wed, 29 Jul 2020 06:24:17 +0000 (06:24 +0000)
commit81baaec0a1ebb05b2b31f084a7b18fd7bedb5d4a
treea5186036c3ac1bf4f48e20d99969154f4627fdfbtree
parent8096f9504d06f9a08726ff24df685cce7fcdcb09commit | diff
v2writable: support async git blob retrievals

This seems to speed up --reindex on smallish v2 inboxes by about
30% on both HDD and SSD.  lore/git (~1GB) on an SSD even gives a
30% improvement with 3 shards.  I'm only seeing a ~4% speedup on
LKML with a SATA SSD (which is difficult to repeat because it
takes around 4 hours).

Testing LKML on an HDD will take much more time...
lib/PublicInbox/SearchIdx.pm diff | blob | history
lib/PublicInbox/V2Writable.pm diff | blob | history
My patches to https://public-inbox.org/public-inbox.git