X-Git-Url: http://www.git.stargrave.org/?a=blobdiff_plain;f=TODO;h=4953439e8c85bdd101a7b394888023c6706c2955;hb=0b1de991a099b5e8b9a9e3e85b5eaaacc9362dbb;hp=0d6f1a078b360f237188ea7b9e76453f80664be3;hpb=88cc653acaa8d8fddb18bfec2cce98e19aa2b0e5;p=public-inbox.git diff --git a/TODO b/TODO index 0d6f1a07..4953439e 100644 --- a/TODO +++ b/TODO @@ -1,24 +1,33 @@ TODO items for public-inbox -(Not in any particular order) +(Not in any particular order, and +performance, ease-of-setup, installation, maintainability, etc +all need to be considered for everything we introduce) -* mailmap support (same as git) for remapping expired email addresses +* general performance improvements, but without relying on + XS or compiled code any more than we currently do. -* WWW: Hybrid flat view + thread skeleton (requires Xapian) +* mailmap support (same as git) for remapping expired email addresses * POP3 server, since some webmail providers support external POP3: https://public-inbox.org/meta/20160411034104.GA7817@dcvr.yhbt.net/ + Perhaps make this depend solely the NNTP server and work as a proxy. + Meaning users can run this without needing a full copy of the + archives in a git repository. + +* HTTP and NNTP proxy support. Allow us to be a frontend for + firewalled off (or Tor-exclusive) instances. The use case is + for offering a publically accessible IP with a cheap VPS, + yet storing large amounts of data on computers without a + public IP behind a home Internet connection. * TLS support for various daemons (including STARTTLS for NNTP and POP3) -* Unix socket support for HTTP and POP3 server for use behind reverse - proxies like nginx +* NNTP COMPRESS extension (see innd) -* Combined "super server" for NNTP/HTTP/POP3 to reduce memory overhead +* Support more of RFC 3977 (NNTP) -* Optional reply-to-list support for mirroring lists that want it :< - Reply-to-list encourages the existing list as a single-point-of-failure, - but having an extra mirror using public-inbox.org is nice regardless. +* Combined "super server" for NNTP/HTTP/POP3 to reduce memory overhead * Configurable linkification for per-inbox shorthands: "$gmane/123456" could be configured to expand to the @@ -34,19 +43,54 @@ TODO items for public-inbox the links should point to an anchor tag within the same page, instead; giving the user options. -* implement RFC 4685 (Atom message threading) - * configurable constants (index limits, search results) -* use tags as date-based skiplists for navigating history - (maybe not needed with Xapian support nowadays?) +* handle messages with multiple Message-IDs (done for v2, doable for v1) + +* handle broken double-bracketed References properly (maybe) + and totally broken Message-IDs + + cf. https://public-inbox.org/git/20160814012706.GA18784@starla/ + +* improve documentation -* handle Xapian date range queries: - http://mid.gmane.org/20151005222157.GE5880@survex.com +* linkify thread skeletons better + https://public-inbox.org/git/6E3699DEA672430CAEA6DEFEDE6918F4@PhilipOakley/ + +* streaming Email::MIME replacement: currently we generate many + allocations/strings for headers we never look at and slurp + entire message bodies into memory. + (this is pie-in-the-sky territory...) * use REQUEST_URI properly for CGI / mod_perl2 compatibility with Message-IDs which include '%' (done?) -* more test cases (use git fast-import to speed up creation) +* more and better test cases (use git fast-import to speed up creation) + +* large mbox/Maildir/MH/NNTP spool import (see PublicInbox::Import) + +* Read-only WebDAV interface to the git repo so it can be mounted + via davfs2 or fusedav to avoid full clones. + davfs2 needs Range: request support for this to be feasible: + https://savannah.nongnu.org/bugs/?33259 + https://savannah.nongnu.org/support/?107649 + +* Contribute something like IMAP IDLE for "git fetch". + Inboxes (and any git repos) can be kept up-to-date without + relying on polling. + +* Expose targeted reindexing of individual messages. + Sometimes an indexing bug only affects a handful of messages, + so it's not worth the trouble of doing a full reindex. + +* code repository integration (with cgit, gitweb, etc...) + +* migration path to v2 without breaking v1 "git fetch" cronjobs + +* imperfect scraper importers for obfuscated list archives + (e.g. obfuscated Mailman stuff, Google Groups, etc...) + +* support hooks, since low-level git-fast-import does not run them + https://public-inbox.org/meta/20190405174329.GA21472@chatter.qube.local/ -* large mbox/Maildir/MH/NNTP spool import (use git fast-import) +* investigate native grokmirror support/integration