X-Git-Url: http://www.git.stargrave.org/?p=public-inbox.git;a=blobdiff_plain;f=TODO;h=611d623a9b1be1ad2b534190f0cb94ebcf2f7d29;hp=7bd68c7b816bd5e13a44119fe70d068663be3c74;hb=e3e9ebdaaf2c2f8192fc003f1857979f933b9a8b;hpb=2c5ef3910834b1a931bc83d294181dc6baddddd3 diff --git a/TODO b/TODO index 7bd68c7b..611d623a 100644 --- a/TODO +++ b/TODO @@ -5,10 +5,14 @@ performance, ease-of-setup, installation, maintainability, etc all need to be considered for everything we introduce) * general performance improvements, but without relying on - XS or compiled code any more than we currently do. + XS or pre-built modules any more than we currently do. + (Optional Inline::C and user-compiled re2c acceptable) * mailmap support (same as git) for remapping expired email addresses +* support remapping of expired URLs similar to mailmap + (coordinate with git.git with this?) + * POP3 server, since some webmail providers support external POP3: https://public-inbox.org/meta/20160411034104.GA7817@dcvr.yhbt.net/ Perhaps make this depend solely the NNTP server and work as a proxy. @@ -17,11 +21,15 @@ all need to be considered for everything we introduce) * HTTP and NNTP proxy support. Allow us to be a frontend for firewalled off (or Tor-exclusive) instances. The use case is - for offering a publically accessible IP with a cheap VPS, + for offering a publicly accessible IP with a cheap VPS, yet storing large amounts of data on computers without a public IP behind a home Internet connection. -* TLS support for various daemons (including STARTTLS for NNTP and POP3) +* support HTTP(S) CONNECT proxying to NNTP for users with + firewall problems + +* DHT (distributed hash table) for mapping Message-IDs to various + archive locations to avoid SPOF. * optional Cache::FastMmap support so production deployments won't need Varnish (Varnish doesn't protect NNTP, either) @@ -33,15 +41,13 @@ all need to be considered for everything we introduce) ensure things continue working as they should (or more better) while retaining compatibility with old versions. -* NNTP COMPRESS extension (see innd) - * Support more of RFC 3977 (NNTP) * Combined "super server" for NNTP/HTTP/POP3 to reduce memory overhead * Configurable linkification for per-inbox shorthands: "$gmane/123456" could be configured to expand to the - appropriate link pointing to the gmane.org list archives, + appropriate link pointing to the gmane.io list archives, likewise "[Bug #123456]" could be configured to expand to point to some project's bug tracker at http://example.com/bug/123456 @@ -69,10 +75,9 @@ all need to be considered for everything we introduce) * linkify thread skeletons better https://public-inbox.org/git/6E3699DEA672430CAEA6DEFEDE6918F4@PhilipOakley/ -* streaming Email::MIME replacement: currently we generate many +* low-memory Email::MIME replacement: currently we generate many allocations/strings for headers we never look at and slurp - entire message bodies into memory. - (this is pie-in-the-sky territory...) + entire message bodies into memory. GMime+Inline::C could work. * use REQUEST_URI properly for CGI / mod_perl2 compatibility with Message-IDs which include '%' (done?) @@ -105,7 +110,36 @@ all need to be considered for everything we introduce) * imperfect scraper importers for obfuscated list archives (e.g. obfuscated Mailman stuff, Google Groups, etc...) -* support hooks, since low-level git-fast-import does not run them - https://public-inbox.org/meta/20190405174329.GA21472@chatter.qube.local/ +* improve performance and avoid head-of-line blocking on slow storage + +* share "git cat-file --batch" processes across inboxes to avoid + bumping into /proc/sys/fs/pipe-user-pages-* limits + +* make "git cat-file --batch" detect unlinked packfiles so we don't + have to restart processes (very long-term) + +* support searching based on `git-patch-id --stable` to improve + bidirectional mapping of commits <=> emails + +* linter to check validity of config file + +* linter option and WWW endpoint to graph relationships and flows + between inboxes, addresses maildirs, coderepos, etc... + +* pygments support - via Python script similar to `git cat-file --batch' + to avoid startup penalty. pygments.rb (Ruby) can be inspiration, too. + +* highlighting + linkification for "git format-patch --interdiff" output + +* highlighting + linkification for "git format-patch --range-diff" output + (requires mirroring of git repos) + +* parse and allow (semi)automatic-mirroring of "git request-pull" output + for coderepos + +* configurable diff output for solver-generated blobs + +* figure out how search for messages with multiple Date: headers + should work (some wacky examples out there...) -* investigate native grokmirror support/integration +* support UUCP addresses for legacy archives