Fast Tar And Rsync Transfer Speed For Linux Backups Using Zstd Compression
I can confirm, zstd is awesome — must use xxHash more, too.
Newer Tar 1.32+ and Rsync 3.2.3 versions have added Facebookâs zstd compression algorithm and Rsync has added lz4 and xxHash checksum algorithms which give Tar and Rsync a tremendous boost in transfer speed.
(tags: tar rsync backups xxhash hashing performance speed zstd compression lz4)
Cyan4973/xxHash: Extremely fast non-cryptographic hash algorithm
significantly faster than Murmur3 and City32; SSE code is even faster than sequential RAM reads :)
(tags: hashing hash xxhash performance coding speed algorithms)