Alexander Motin 2d33c8edb6 Make rewrite use Uncached I/O ...

Rewrite is a one-time/rare bulk administrative operation, which
should minimally affect payload caching.  Plus some avoided memory
copies in its data path allow to significantly increase its speed.

My tests show reduction of time to rewrite 28GB of uncompressed
files on NVMe pool from 17 to 9 seconds and minimal ARC usage.

Reviewed-by: Brian Behlendorf <behlendorf1@llnl.gov>
Signed-off-by:	Alexander Motin <mav@FreeBSD.org>
Sponsored by:	iXsystems, Inc.
Closes #17407

2025-05-30 21:13:49 -04:00

..

abd.c

Export correct symbols for Lustre Direct I/O

2025-04-24 13:55:21 -04:00

aggsum.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

arc.c

tunables: ensure tunable and variable have same define gate

2025-05-28 16:50:22 -07:00

blake3_zfs.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

blkptr.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

bplist.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

bpobj.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

bptree.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

bqueue.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

brt.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

btree.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dataset_kstats.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dbuf_stats.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dbuf.c

ARC: Notify dbuf cache about target size reduction

2025-05-14 10:34:14 -04:00

ddt_log.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

ddt_stats.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

ddt_zap.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

ddt.c

tunables: fix spelling

2025-05-28 16:50:22 -07:00

dmu_diff.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dmu_direct.c

Wire O_DIRECT also to Uncached I/O (#17218)

2025-05-13 14:26:55 -07:00

dmu_object.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dmu_objset.c

dmu_objset_hold_flags() should call dsl_dataset_rele_flags() on error

2025-05-20 08:35:45 -07:00

dmu_recv.c

Wire O_DIRECT also to Uncached I/O (#17218)

2025-05-13 14:26:55 -07:00

dmu_redact.c

dmu_tx_assign: make all VERIFY0 calls use DMU_TX_SUSPEND

2025-05-28 10:28:59 -07:00

dmu_send.c

Fix 2 bugs in non-raw send with encryption

2025-05-19 09:55:00 -07:00

dmu_traverse.c

dmu_traverse: remove 'ignore_hole_birth' tunable alias

2025-05-27 15:05:09 -07:00

dmu_tx.c

dmu_tx: break tx assign/wait when pool suspends

2025-05-28 10:28:51 -07:00

dmu_zfetch.c

Wire O_DIRECT also to Uncached I/O (#17218)

2025-05-13 14:26:55 -07:00

dmu.c

FreeBSD: Add posix_fadvise(POSIX_FADV_WILLNEED) support

2025-05-29 09:34:07 -04:00

dnode_sync.c

Wire O_DIRECT also to Uncached I/O (#17218)

2025-05-13 14:26:55 -07:00

dnode.c

Wire O_DIRECT also to Uncached I/O (#17218)

2025-05-13 14:26:55 -07:00

dsl_bookmark.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dsl_crypt.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dsl_dataset.c

Expose dataset encryption status via fast stat path

2025-05-26 22:11:03 -04:00

dsl_deadlist.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dsl_deleg.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dsl_destroy.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dsl_dir.c

cred: properly pass and test creds on other threads (#17273)

2025-04-29 16:27:48 -07:00

dsl_pool.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dsl_prop.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

dsl_scan.c

dmu_tx_assign: make all VERIFY0 calls use DMU_TX_SUSPEND

2025-05-28 10:28:59 -07:00

dsl_synctask.c

dmu_tx_assign: make all VERIFY0 calls use DMU_TX_SUSPEND

2025-05-28 10:28:59 -07:00

dsl_userhold.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

edonr_zfs.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

fm.c

tunables: ensure tunable and variable have same define gate

2025-05-28 16:50:22 -07:00

gzip.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

hkdf.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

lz4_zfs.c

SPDX: license tags: BSD-2-Clause

2025-03-13 17:56:46 -07:00

lz4.c

SPDX: license tags: BSD-2-Clause

2025-03-13 17:56:46 -07:00

lzjb.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

metaslab.c

metaslab_alloc: make hint BP and DVA const (#17324)

2025-05-12 10:52:46 -07:00

mmp.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

multilist.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

objlist.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

pathname.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

range_tree.c

Fix off-by-one bug in range tree code

2025-05-23 10:33:33 -04:00

refcount.c

Implement allocation size ranges and use for gang leaves (#17111)

2025-05-02 15:32:18 -07:00

rrwlock.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

sa.c

Wire O_DIRECT also to Uncached I/O (#17218)

2025-05-13 14:26:55 -07:00

sha2_zfs.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

skein_zfs.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

spa_checkpoint.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

spa_config.c

tunables: ensure tunable and variable have same define gate

2025-05-28 16:50:22 -07:00

spa_errlog.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

spa_history.c

dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)

2025-03-18 16:04:22 -07:00

spa_log_spacemap.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

spa_misc.c

Allow opt-in of zvol blocks in special class

2025-05-24 16:44:26 -04:00

spa_stats.c

Wire O_DIRECT also to Uncached I/O (#17218)

2025-05-13 14:26:55 -07:00

spa.c

Set spa_final_txg in spa_unload()

2025-05-30 14:44:45 -04:00

space_map.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

space_reftree.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

THIRDPARTYLICENSE.cityhash

OpenZFS 8484 - Implement aggregate sum and use for arc counters

2018-06-06 09:35:59 -07:00

THIRDPARTYLICENSE.cityhash.descrip

OpenZFS 8484 - Implement aggregate sum and use for arc counters

2018-06-06 09:35:59 -07:00

txg.c

txg_wait_synced_flags: add TXG_WAIT_SUSPEND flag to not wait if pool suspended

2025-05-28 10:27:46 -07:00

uberblock.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

unique.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_draid_rand.c

SPDX: license tags: LicenseRef-OpenZFS-ThirdParty-PublicDomain

2025-03-13 17:57:31 -07:00

vdev_draid.c

Implement allocation size ranges and use for gang leaves (#17111)

2025-05-02 15:32:18 -07:00

vdev_file.c

Implement allocation size ranges and use for gang leaves (#17111)

2025-05-02 15:32:18 -07:00

vdev_indirect_births.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_indirect_mapping.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_indirect.c

dmu_tx_assign: make all VERIFY0 calls use DMU_TX_SUSPEND

2025-05-28 10:28:59 -07:00

vdev_initialize.c

dmu_tx_assign: make all VERIFY0 calls use DMU_TX_SUSPEND

2025-05-28 10:28:59 -07:00

vdev_label.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_mirror.c

Implement allocation size ranges and use for gang leaves (#17111)

2025-05-02 15:32:18 -07:00

vdev_missing.c

Implement allocation size ranges and use for gang leaves (#17111)

2025-05-02 15:32:18 -07:00

vdev_queue.c

Unified allocation throttling (#17020)

2025-03-24 09:25:01 -07:00

vdev_raidz_math_aarch64_neon_common.h

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_aarch64_neon.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_aarch64_neonx2.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_avx2.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_avx512bw.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_avx512f.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_impl.h

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_powerpc_altivec_common.h

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_powerpc_altivec.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_scalar.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_sse2.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math_ssse3.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

vdev_raidz_math.c

tunables: don't assert initialisation in impl getters

2025-05-28 16:50:22 -07:00

vdev_raidz.c

dmu_tx_assign: make all VERIFY0 calls use DMU_TX_SUSPEND

2025-05-28 10:28:59 -07:00

vdev_rebuild.c

dmu_tx_assign: make all VERIFY0 calls use DMU_TX_SUSPEND

2025-05-28 10:28:59 -07:00

vdev_removal.c

dmu_tx_assign: make all VERIFY0 calls use DMU_TX_SUSPEND

2025-05-28 10:28:59 -07:00

vdev_root.c

Implement allocation size ranges and use for gang leaves (#17111)

2025-05-02 15:32:18 -07:00

vdev_trim.c

dmu_tx_assign: make all VERIFY0 calls use DMU_TX_SUSPEND

2025-05-28 10:28:59 -07:00

vdev.c

vdev: skip faulting disks pending removal

2025-05-30 09:14:37 -07:00

zap_leaf.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zap_micro.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zap.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zcp_get.c

zcp: get_prop: fix encryptionroot and encryption

2025-05-27 20:04:37 -04:00

zcp_global.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zcp_iter.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zcp_set.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zcp_synctask.c

cred: properly pass and test creds on other threads (#17273)

2025-04-29 16:27:48 -07:00

zcp.c

txg: generalise txg_wait_synced_sig() to txg_wait_synced_flags() (#17284)

2025-05-02 15:29:50 -07:00

zfeature.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zfs_byteswap.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zfs_chksum.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zfs_debug_common.c

nvlist: Add nvlist_snprintf() and zfs_dbgmsg_nvlist()

2025-04-18 09:22:16 -04:00

zfs_fm.c

events: include zio type in IO error reports

2025-05-30 10:29:29 -04:00

zfs_fuid.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zfs_impl.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zfs_ioctl.c

Show default quotas in zfs userspace tools

2025-04-03 10:36:45 -07:00

zfs_log.c

zfs_log: make zfs_immediate_write_sz uint

2025-05-28 16:50:22 -07:00

zfs_onexit.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zfs_quota.c

Show default quotas in zfs userspace tools

2025-04-03 10:36:45 -07:00

zfs_ratelimit.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zfs_replay.c

dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)

2025-03-18 16:04:22 -07:00

zfs_rlock.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zfs_sa.c

dmu_tx: rename dmu_tx_assign() flags from TXG_* to DMU_TX_* (#17143)

2025-03-18 16:04:22 -07:00

zfs_vnops.c

Make rewrite use Uncached I/O

2025-05-30 21:13:49 -04:00

zfs_znode.c

Add default user/group/project quota properties

2025-04-03 10:35:22 -07:00

zil.c

dmu_tx_assign: make all VERIFY0 calls use DMU_TX_SUSPEND

2025-05-28 10:28:59 -07:00

zio_checksum.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zio_compress.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zio_inject.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zio.c

Only interrupt active disk I/Os in failmode=continue

2025-05-28 15:31:32 -07:00

zle.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zrlock.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zthr.c

SPDX: license tags: CDDL-1.0

2025-03-13 17:56:27 -07:00

zvol.c

Rename zvol kernel module parameters sysctls on FreeBSD side

2025-05-30 13:41:15 -07:00