X-Git-Url: http://www.git.stargrave.org/?p=public-inbox.git;a=blobdiff_plain;f=TODO;h=16de36bf200685ed8e59ede350966e9976b1682b;hp=93054bb3129b502abad1b77e315db6c761016450;hb=cc5d9ec286f758de07b57087cfd537759b93dabe;hpb=b27722260936cd68009f7c1bebc90f22794c0d37 diff --git a/TODO b/TODO index 93054bb3..16de36bf 100644 --- a/TODO +++ b/TODO @@ -6,21 +6,31 @@ all need to be considered for everything we introduce) * general performance improvements, but without relying on XS or pre-built modules any more than we currently do. + (Optional Inline::C and user-compiled re2c acceptable) * mailmap support (same as git) for remapping expired email addresses +* support remapping of expired URLs similar to mailmap + (coordinate with git.git with this?) + * POP3 server, since some webmail providers support external POP3: https://public-inbox.org/meta/20160411034104.GA7817@dcvr.yhbt.net/ Perhaps make this depend solely the NNTP server and work as a proxy. Meaning users can run this without needing a full copy of the - archives in a git repository. + archives in git repositories. * HTTP and NNTP proxy support. Allow us to be a frontend for firewalled off (or Tor-exclusive) instances. The use case is - for offering a publically accessible IP with a cheap VPS, + for offering a publicly accessible IP with a cheap VPS, yet storing large amounts of data on computers without a public IP behind a home Internet connection. +* support HTTP(S) CONNECT proxying to NNTP for users with + firewall problems + +* DHT (distributed hash table) for mapping Message-IDs to various + archive locations to avoid SPOF. + * optional Cache::FastMmap support so production deployments won't need Varnish (Varnish doesn't protect NNTP, either) @@ -32,12 +42,13 @@ all need to be considered for everything we introduce) while retaining compatibility with old versions. * Support more of RFC 3977 (NNTP) + Is there anything left for read-only support? * Combined "super server" for NNTP/HTTP/POP3 to reduce memory overhead * Configurable linkification for per-inbox shorthands: "$gmane/123456" could be configured to expand to the - appropriate link pointing to the gmane.org list archives, + appropriate link pointing to the gmane.io list archives, likewise "[Bug #123456]" could be configured to expand to point to some project's bug tracker at http://example.com/bug/123456 @@ -65,10 +76,9 @@ all need to be considered for everything we introduce) * linkify thread skeletons better https://public-inbox.org/git/6E3699DEA672430CAEA6DEFEDE6918F4@PhilipOakley/ -* streaming Email::MIME replacement: currently we generate many - allocations/strings for headers we never look at and slurp - entire message bodies into memory. - (this is pie-in-the-sky territory...) +* Further lower mail parser memory usage. We still slurp entire + message bodies into memory and incur 2-3x overhead on + multipart messages. Inline::C (and maybe gmime) could work. * use REQUEST_URI properly for CGI / mod_perl2 compatibility with Message-IDs which include '%' (done?) @@ -94,17 +104,13 @@ all need to be considered for everything we introduce) Sometimes an indexing bug only affects a handful of messages, so it's not worth the trouble of doing a full reindex. -* code repository integration (with cgit, gitweb, etc...) +* code repository integration (cgit: done, TODO: gitweb, etc...) * migration path to v2 without breaking v1 "git fetch" cronjobs * imperfect scraper importers for obfuscated list archives (e.g. obfuscated Mailman stuff, Google Groups, etc...) -* consider using HTTP::Date instead of Date::Parse, since we need the - former is capable of parsing RFC822-ish dates, used by Plack, and - the latter is missing from OpenBSD and maybe other distros. - * improve performance and avoid head-of-line blocking on slow storage * share "git cat-file --batch" processes across inboxes to avoid @@ -115,3 +121,26 @@ all need to be considered for everything we introduce) * support searching based on `git-patch-id --stable` to improve bidirectional mapping of commits <=> emails + +* linter to check validity of config file + +* linter option and WWW endpoint to graph relationships and flows + between inboxes, addresses maildirs, coderepos, etc... + +* pygments support - via Python script similar to `git cat-file --batch' + to avoid startup penalty. pygments.rb (Ruby) can be inspiration, too. + +* highlighting + linkification for "git format-patch --interdiff" output + +* highlighting + linkification for "git format-patch --range-diff" output + (requires mirroring of git repos) + +* parse and allow (semi)automatic-mirroring of "git request-pull" output + for coderepos + +* configurable diff output for solver-generated blobs + +* figure out how search for messages with multiple Date: headers + should work (some wacky examples out there...) + +* support UUCP addresses for legacy archives