I’m trying to avoid doing this in order to avoid more power consumption and unpopular hardware in the house — but if necessary, this is a good up-to-date homebuild design
Interesting article around using mmap’d files from Java using RandomAccessFile.getChannel().map(), which allows them to be accessed directly as a ByteBuffer. together with Atomic variable lazySet() operations, this provides pretty excellent performance results on low-latency writes to disk. See also: http://psy-lob-saw.blogspot.ie/2012/12/atomiclazyset-is-performance-win-for.html
a realtime processing engine, built on a persistent queue and a set of workers. ‘The main goal is data availability and persistency. We created grape for those who cannot afford losing data’. It does this by allowing infinite expansion of the pending queue in Elliptics, their Dynamo-like horizontally-scaled storage backend.
‘remember, there is no axe murderer. probably’
MITM attacks via BGP route hijacking now relatively commonplace on the internet, with 60 cases observed so far this year by Renesys