Rich Ercolani f375b23c02 Tiered early abort, zstd edition ... It turns out that "do LZ4 and zstd-1 both fail" is a great heuristic for "don't even bother trying higher zstd tiers". By way of illustration: $ cat /incompress | mbuffer | zfs recv -o compression=zstd-12 evenfaster/lowcomp_1M_zstd12_normal summary: 39.8 GiByte in 3min 40.2sec - average of 185 MiB/s $ echo 3 | sudo tee /sys/module/zzstd/parameters/zstd_lz4_pass 3 $ cat /incompress | mbuffer -m 4G | zfs recv -o compression=zstd-12 evenfaster/lowcomp_1M_zstd12_patched summary: 39.8 GiByte in 48.6sec - average of 839 MiB/s $ sudo zfs list -p -o name,used,lused,ratio evenfaster/lowcomp_1M_zstd12_normal evenfaster/lowcomp_1M_zstd12_patched NAME USED LUSED RATIO evenfaster/lowcomp_1M_zstd12_normal 39549931520 42721221632 1.08 evenfaster/lowcomp_1M_zstd12_patched 39626399744 42721217536 1.07 $ python3 -c "print(39626399744 - 39549931520)" 76468224 $ I'll take 76 MB out of 42 GB for > 4x speedup. Reviewed-by: Allan Jude <allan@klarasystems.com> Reviewed-by: Brian Behlendorf <behlendorf1@llnl.gov> Reviewed-by: George Melikov <mail@gmelikov.ru> Reviewed-by: Kjeld Schouten <kjeld@schouten-lebbing.nl> Reviewed-by: Ahelenia Ziemiańska <nabijaczleweli@nabijaczleweli.xyz> Signed-off-by: Rich Ercolani <rincebrain@gmail.com> Closes #13244		2022-05-24 09:43:22 -07:00
..
man1	ztest: take -B ./path/to/ztest, LD_LIBRARY_PATH=./path/lib:$L_L_P	2022-05-11 10:33:12 -07:00
man4	Tiered early abort, zstd edition	2022-05-24 09:43:22 -07:00
man5	Consistentify miscellaneous style on remaining manpages	2021-06-09 14:35:53 -07:00
man7	Fix incorrect use of unit prefix names in man pages	2022-05-04 11:44:12 -07:00
man8	linux: libzfs: simplify module-loaded check	2022-05-18 12:51:42 -07:00
Makefile.am	Move test-runner.1 into top-level man/	2022-05-10 10:19:18 -07:00