From: Eric Wong Date: Tue, 15 Apr 2014 02:38:07 +0000 (+0000) Subject: doc: add notes on scalability X-Git-Tag: v1.0.0~1254 X-Git-Url: http://www.git.stargrave.org/?p=public-inbox.git;a=commitdiff_plain;h=7182847eba14dabed5489900ec2f64b1ebf8ff0d doc: add notes on scalability Fortunately, most mailing lists will never grow too large. --- diff --git a/Documentation/design_notes.txt b/Documentation/design_notes.txt index f81a616f..286f35c0 100644 --- a/Documentation/design_notes.txt +++ b/Documentation/design_notes.txt @@ -128,6 +128,20 @@ Web notes * Raw text endpoint allows users to write client-side JS endpoints without hosting the data themselves (or on a different server). +Scalability notes +----------------- + +Even with shallow clone, storing the history of large/busy mailing lists +may place much burden on subscribers and servers. However, having a +single (or few) refs representing the entire history of a list is good +for small lists since it's easier to lookup a message by Message-ID, so +we want to avoid splitting refs with independent histories. + +ssoma will likely grow its own builtin ref rotation system based on +message count (not rotating at fixed time intervals). This would +split the histories and require O(n) lookup time based on Message-ID, +where `n' is the number of history splits. + Copyright --------- Copyright 2013, Eric Wong and all contributors.