Robert Evans a60214e792 dnode_next_offset: backtrack if lower level does not match ... This changes the basic search algorithm from a single search up and down the tree to a full depth-first traversal to handle conditions where the tree matches at a higher level but not a lower level. Normally higher level blocks always point to matching blocks, but there are cases where this does not happen: 1. Racing block pointer updates from dbuf_write_ready. Before f664f1ee7f (#8946), both dbuf_write_ready and dnode_next_offset held dn_struct_rwlock which protected against pointer writes from concurrent syncs. This no longer applies, so sync context can f.e. clear or fill all L1->L0 BPs before the L2->L1 BP and higher BP's are updated. dnode_free_range in particular can reach this case and skip over L1 blocks that need to be dirtied. Later, sync will panic in free_children when trying to clear a non-dirty indirect block. This case was found with ztest. 2. txg > 0, non-hole case. This is #11196. Freeing blocks/dnodes breaks the assumption that a match at a higher level implies a match at a lower level when filtering txg > 0. Whenever some but not all L0 blocks are freed, the parent L1 block is rewritten. Its updated L2->L1 BP reflects a newer birth txg. Later when searching by txg, if the L1 block matches since the txg is newer, it is possible that none of the remaining L1->L0 BPs match if none have been updated. The same behavior is possible with dnode search at L0. This is reachable from dsl_destroy_head for synchronous freeing. When this happens open context fails to free objects leaving sync context stuck freeing potentially many objects. This is also reachable from traverse_pool for extreme rewind where it is theoretically possible that datasets not dirtied after txg are skipped if the MOS has high enough indirection to trigger this case. In both of these cases, without backtracking the search ends prematurely as ESRCH result implies no more matches in the entire object. Reviewed-by: Brian Behlendorf <behlendorf1@llnl.gov> Reviewed-by: Akash B <akash-b@hpe.com> Signed-off-by: Robert Evans <evansr@google.com> Closes #16025 Closes #11196		2025-10-21 11:30:30 -07:00
..
abd.c	Export correct symbols for Lustre Direct I/O	2025-05-28 16:00:28 -07:00
aggsum.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
arc.c	enforce arc_dnode_limit	2025-08-07 12:11:34 -04:00
blake3_zfs.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
blkptr.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
bplist.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
bpobj.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
bptree.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
bqueue.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
brt.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
btree.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dataset_kstats.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dbuf_stats.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dbuf.c	Skip dbuf_evict_one() from dbuf_evict_notify() for reclaim thread	2025-08-07 12:15:14 -04:00
ddt_log.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
ddt_stats.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
ddt_zap.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
ddt.c	FDT dedup log sync -- remove incremental	2025-08-05 12:15:21 -04:00
dmu_diff.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dmu_direct.c	Export correct symbols for Lustre Direct I/O	2025-05-28 16:00:28 -07:00
dmu_object.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dmu_objset.c	dmu_objset_hold_flags() should call dsl_dataset_rele_flags() on error	2025-05-28 16:00:28 -07:00
dmu_recv.c	Make ganging redundancy respect redundant_metadata property (#17073)	2025-08-05 13:10:40 -04:00
dmu_redact.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
dmu_send.c	Fix 2 bugs in non-raw send with encryption	2025-05-28 16:00:28 -07:00
dmu_traverse.c	dmu_traverse: remove 'ignore_hole_birth' tunable alias	2025-06-17 10:50:27 -07:00
dmu_tx.c	Improve block cloning transactions accounting	2025-06-17 10:50:26 -07:00
dmu_zfetch.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dmu.c	Increase meta-dnode redundancy in "some" mode	2025-08-05 13:15:44 -04:00
dnode_sync.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dnode.c	dnode_next_offset: backtrack if lower level does not match	2025-10-21 11:30:30 -07:00
dsl_bookmark.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_crypt.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_dataset.c	Expose dataset encryption status via fast stat path	2025-06-17 10:49:40 -07:00
dsl_deadlist.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_deleg.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_destroy.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_dir.c	cred: properly pass and test creds on other threads (#17273)	2025-05-28 16:00:28 -07:00
dsl_pool.c	During pool export flush the ARC asynchronously	2025-06-17 10:50:26 -07:00
dsl_prop.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
dsl_scan.c	scrub: generate scrub_finish event	2025-08-05 12:21:46 -04:00
dsl_synctask.c	txg: generalise txg_wait_synced_sig() to txg_wait_synced_flags() (#17284)	2025-05-28 16:00:28 -07:00
dsl_userhold.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
edonr_zfs.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
fm.c	tunables: ensure tunable and variable have same define gate	2025-06-17 10:50:26 -07:00
gzip.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
hkdf.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
lz4_zfs.c	SPDX: license tags: BSD-2-Clause	2025-04-16 09:59:44 -07:00
lz4.c	SPDX: license tags: BSD-2-Clause	2025-04-16 09:59:44 -07:00
lzjb.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
metaslab.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
mmp.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
multilist.c	Allow vmem_alloc backed multilists	2025-08-12 17:24:30 -07:00
objlist.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
pathname.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
range_tree.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
refcount.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
rrwlock.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
sa.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
sha2_zfs.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
skein_zfs.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
spa_checkpoint.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
spa_config.c	Add interface to interface spa_get_worst_case_min_alloc() function	2025-10-21 11:02:42 -07:00
spa_errlog.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
spa_history.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
spa_log_spacemap.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
spa_misc.c	Add interface to interface spa_get_worst_case_min_alloc() function	2025-10-21 11:02:42 -07:00
spa_stats.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
spa.c	spa: ZIO_TASKQ_ISSUE: Use symbolic priority	2025-08-12 17:16:00 -07:00
space_map.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
space_reftree.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
THIRDPARTYLICENSE.cityhash	OpenZFS 8484 - Implement aggregate sum and use for arc counters	2018-06-06 09:35:59 -07:00
THIRDPARTYLICENSE.cityhash.descrip	OpenZFS 8484 - Implement aggregate sum and use for arc counters	2018-06-06 09:35:59 -07:00
txg.c	txg: generalise txg_wait_synced_sig() to txg_wait_synced_flags() (#17284)	2025-05-28 16:00:28 -07:00
uberblock.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
unique.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_draid_rand.c	SPDX: license tags: LicenseRef-OpenZFS-ThirdParty-PublicDomain	2025-04-16 09:59:45 -07:00
vdev_draid.c	Fix other nonrot bugs	2025-08-05 12:25:26 -04:00
vdev_file.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_indirect_births.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_indirect_mapping.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_indirect.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
vdev_initialize.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
vdev_label.c	Add interface to interface spa_get_worst_case_min_alloc() function	2025-10-21 11:02:42 -07:00
vdev_mirror.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_missing.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_queue.c	FDT dedup log sync -- remove incremental	2025-08-05 12:15:21 -04:00
vdev_raidz_math_aarch64_neon_common.h	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_aarch64_neon.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_aarch64_neonx2.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_avx2.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_avx512bw.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_avx512f.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_impl.h	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_powerpc_altivec_common.h	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_powerpc_altivec.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_scalar.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_sse2.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math_ssse3.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_raidz_math.c	tunables: don't assert initialisation in impl getters	2025-06-17 10:50:26 -07:00
vdev_raidz.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
vdev_rebuild.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
vdev_removal.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
vdev_root.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
vdev_trim.c	range_tree: Provide more debug details upon unexpected add/remove	2025-08-05 12:34:54 -04:00
vdev.c	Add interface to interface spa_get_worst_case_min_alloc() function	2025-10-21 11:02:42 -07:00
zap_leaf.c	ZAP: Reduce leaf array and free chunks fragmentation	2025-05-28 16:00:28 -07:00
zap_micro.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zap.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zcp_get.c	zcp: get_prop: fix encryptionroot and encryption	2025-06-17 10:49:40 -07:00
zcp_global.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zcp_iter.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zcp_set.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zcp_synctask.c	cred: properly pass and test creds on other threads (#17273)	2025-05-28 16:00:28 -07:00
zcp.c	txg: generalise txg_wait_synced_sig() to txg_wait_synced_flags() (#17284)	2025-05-28 16:00:28 -07:00
zfeature.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_byteswap.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_chksum.c	Faster checksum benchmark on system boot	2025-08-05 12:34:13 -04:00
zfs_fm.c	zed: Ensure spare activation after kernel-initiated device removal	2025-04-16 09:59:45 -07:00
zfs_fuid.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_impl.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_ioctl.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_log.c	zfs_log_write: only put the callback on the last itx	2025-06-17 10:50:26 -07:00
zfs_onexit.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_quota.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
zfs_ratelimit.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_replay.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
zfs_rlock.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zfs_sa.c	dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)	2025-04-16 09:59:45 -07:00
zfs_vnops.c	Linux: sync: remove async/sync accounting	2025-08-12 17:23:39 -07:00
zfs_znode.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zil.c	ZIL: Force writing of open LWB on suspend	2025-08-05 12:28:41 -04:00
zio_checksum.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zio_compress.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zio_inject.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zio.c	Make ganging redundancy respect redundant_metadata property (#17073)	2025-08-05 13:10:40 -04:00
zle.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zrlock.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zthr.c	SPDX: license tags: CDDL-1.0	2025-04-16 09:59:44 -07:00
zvol.c	Improve block cloning transactions accounting	2025-06-17 10:50:26 -07:00