gonna break these down a bit in a thread-that-should-probably-be-a-post
1. lz4 compression is bad! like, 50% worse than zstd-1 (without dictionary training) block sizes up to 128k
but it's fast right?
4k blocks: ya, 35% faster
8k: no! -37% (slower!)
16k: -14%
32k: -3%
64: -1% slower
128: +4% fast