Paul Dagnelie a46ce73ca8 Make ganging redundancy respect redundant_metadata property (#17073) ... The redundant_metadata setting in ZFS allows users to trade resilience for performance and space savings. This applies to all data and metadata blocks in zfs, with one exception: gang blocks. Gang blocks currently just take the copies property of the IO being ganged and, if it's 1, sets it to 2. This means that we always make at least two copies of a gang header, which is good for resilience. However, if the users care more about performance than resilience, their gang blocks will be even more of a penalty than usual. We add logic to calculate the number of gang headers copies directly, and store it as a separate IO property. This is stored in the IO properties and not calculated when we decide to gang because by that point we may not have easy access to the relevant information about what kind of block is being stored. We also check the redundant_metadata property when doing so, and use that to decide whether to store an extra copy of the gang headers, compared to the underlying blocks. Sponsored-by: Klara, Inc. Sponsored-by: Wasabi Technology, Inc. Signed-off-by: Paul Dagnelie <paul.dagnelie@klarasystems.com> Co-authored-by: Paul Dagnelie <paul.dagnelie@klarasystems.com> Reviewed-by: Alexander Motin <mav@FreeBSD.org> Reviewed-by: Tony Hutter <hutter2@llnl.gov>		2025-08-05 13:10:40 -04:00
..
abd.c	Export correct symbols for Lustre Direct I/O	2025-05-28 16:00:28 -07:00
aggsum.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
arc.c	Make ganging redundancy respect redundant_metadata property (#17073)	2025-08-05 13:10:40 -04:00
blake3_zfs.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
blkptr.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
bplist.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
bpobj.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
bptree.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
bqueue.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
brt.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
btree.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dataset_kstats.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dbuf_stats.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dbuf.c	Make ganging redundancy respect redundant_metadata property (#17073)	2025-08-05 13:10:40 -04:00
ddt_log.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
ddt_stats.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
ddt_zap.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
ddt.c	FDT dedup log sync -- remove incremental	2025-08-05 12:15:21 -04:00
dmu_diff.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dmu_direct.c	Export correct symbols for Lustre Direct I/O	2025-05-28 16:00:28 -07:00
dmu_object.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dmu_objset.c	dmu_objset_hold_flags() should call dsl_dataset_rele_flags() on error	2025-05-28 16:00:28 -07:00
dmu_recv.c	Make ganging redundancy respect redundant_metadata property (#17073)	2025-08-05 13:10:40 -04:00
dmu_redact.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
dmu_send.c	Fix 2 bugs in non-raw send with encryption	2025-05-28 16:00:28 -07:00
dmu_traverse.c	dmu_traverse: remove 'ignore_hole_birth' tunable alias	2025-06-17 10:50:27 -07:00
dmu_tx.c	Improve block cloning transactions accounting	2025-06-17 10:50:26 -07:00
dmu_zfetch.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dmu.c	Make ganging redundancy respect redundant_metadata property (#17073)	2025-08-05 13:10:40 -04:00
dnode_sync.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dnode.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
dsl_bookmark.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_crypt.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_dataset.c	Expose dataset encryption status via fast stat path	2025-06-17 10:49:40 -07:00
dsl_deadlist.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_deleg.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_destroy.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_dir.c	cred: properly pass and test creds on other threads (#17273)	2025-05-28 16:00:28 -07:00
dsl_pool.c	During pool export flush the ARC asynchronously	2025-06-17 10:50:26 -07:00
dsl_prop.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_scan.c	scrub: generate scrub_finish event	2025-08-05 12:21:46 -04:00
dsl_synctask.c	txg: generalise txg_wait_synced_sig() to txg_wait_synced_flags() (#17284)	2025-05-28 16:00:28 -07:00
dsl_userhold.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
edonr_zfs.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
fm.c	tunables: ensure tunable and variable have same define gate	2025-06-17 10:50:26 -07:00
gzip.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
hkdf.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
lz4_zfs.c	SPDX: license tags: BSD-2-Clause	2025-04-16 09:59:44 -07:00
lz4.c	SPDX: license tags: BSD-2-Clause	2025-04-16 09:59:44 -07:00
lzjb.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
metaslab.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
mmp.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
multilist.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
objlist.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
pathname.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
range_tree.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
refcount.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
rrwlock.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
sa.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
sha2_zfs.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
skein_zfs.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
spa_checkpoint.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
spa_config.c	tunables: ensure tunable and variable have same define gate	2025-06-17 10:50:26 -07:00
spa_errlog.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
spa_history.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
spa_log_spacemap.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
spa_misc.c	During pool export flush the ARC asynchronously	2025-06-17 10:50:26 -07:00
spa_stats.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
spa.c	Set spa_final_txg in spa_unload()	2025-06-17 10:50:26 -07:00
space_map.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
space_reftree.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
THIRDPARTYLICENSE.cityhash	OpenZFS 8484 - Implement aggregate sum and use for arc counters	2018-06-06 09:35:59 -07:00
THIRDPARTYLICENSE.cityhash.descrip	OpenZFS 8484 - Implement aggregate sum and use for arc counters	2018-06-06 09:35:59 -07:00
txg.c	txg: generalise txg_wait_synced_sig() to txg_wait_synced_flags() (#17284)	2025-05-28 16:00:28 -07:00
uberblock.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
unique.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_draid_rand.c	SPDX: license tags: LicenseRef-OpenZFS-ThirdParty-PublicDomain	2025-04-16 09:59:45 -07:00
vdev_draid.c	Fix other nonrot bugs	2025-08-05 12:25:26 -04:00
vdev_file.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_indirect_births.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_indirect_mapping.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_indirect.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
vdev_initialize.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
vdev_label.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_mirror.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_missing.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_queue.c	FDT dedup log sync -- remove incremental	2025-08-05 12:15:21 -04:00
vdev_raidz_math_aarch64_neon_common.h	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_aarch64_neon.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_aarch64_neonx2.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_avx2.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_avx512bw.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_avx512f.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_impl.h	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_powerpc_altivec_common.h	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_powerpc_altivec.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_scalar.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_sse2.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_ssse3.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math.c	tunables: don't assert initialisation in impl getters	2025-06-17 10:50:26 -07:00
vdev_raidz.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
vdev_rebuild.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
vdev_removal.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
vdev_root.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_trim.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
vdev.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
zap_leaf.c	ZAP: Reduce leaf array and free chunks fragmentation	2025-05-28 16:00:28 -07:00
zap_micro.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zap.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zcp_get.c	zcp: get_prop: fix encryptionroot and encryption	2025-06-17 10:49:40 -07:00
zcp_global.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zcp_iter.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zcp_set.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zcp_synctask.c	cred: properly pass and test creds on other threads (#17273)	2025-05-28 16:00:28 -07:00
zcp.c	txg: generalise txg_wait_synced_sig() to txg_wait_synced_flags() (#17284)	2025-05-28 16:00:28 -07:00
zfeature.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_byteswap.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_chksum.c	Faster checksum benchmark on system boot	2025-08-05 12:34:13 -04:00
zfs_fm.c	zed: Ensure spare activation after kernel-initiated device removal	2025-04-16 09:59:45 -07:00
zfs_fuid.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_impl.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_ioctl.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_log.c	zfs_log_write: only put the callback on the last itx	2025-06-17 10:50:26 -07:00
zfs_onexit.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_quota.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
zfs_ratelimit.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_replay.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
zfs_rlock.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_sa.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
zfs_vnops.c	Default to zfs_bclone_wait_dirty=1	2025-08-05 12:33:30 -04:00
zfs_znode.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zil.c	ZIL: Force writing of open LWB on suspend	2025-08-05 12:28:41 -04:00
zio_checksum.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zio_compress.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zio_inject.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zio.c	Make ganging redundancy respect redundant_metadata property (#17073)	2025-08-05 13:10:40 -04:00
zle.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zrlock.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zthr.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zvol.c	Improve block cloning transactions accounting	2025-06-17 10:50:26 -07:00