c/mirror_zfs
1
0
Fork 0
mirror of https://git.proxmox.com/git/mirror_zfs.git synced 2024-12-29 04:19:35 +03:00
Code Issues Packages Projects Releases Wiki Activity
6930ecbb75
mirror_zfs/include/os/freebsd/spl/sys
History
Rob N 6930ecbb75
spa: make read/write queues configurable 
We are finding that as customers get larger and faster machines
(hundreds of cores, large NVMe-backed pools) they keep hitting
relatively low performance ceilings. Our profiling work almost always
finds that they're running into bottlenecks on the SPA IO taskqs.
Unfortunately there's often little we can advise at that point, because
there's very few ways to change behaviour without patching.

This commit adds two load-time parameters `zio_taskq_read` and
`zio_taskq_write` that can configure the READ and WRITE IO taskqs
directly.

This achieves two goals: it gives operators (and those that support
them) a way to tune things without requiring a custom build of OpenZFS,
which is often not possible, and it lets us easily try different config
variations in a variety of environments to inform the development of
better defaults for these kind of systems.

Because tuning the IO taskqs really requires a fairly deep understanding
of how IO in ZFS works, and generally isn't needed without a pretty
serious workload and an ability to identify bottlenecks, only minimal
documentation is provided. Its expected that anyone using this is going
to have the source code there as well.

Sponsored-by: Klara, Inc.
Sponsored-by: Wasabi Technology, Inc.
Reviewed-by: Brian Behlendorf <behlendorf1@llnl.gov>
Signed-off-by: Rob Norris <rob.norris@klarasystems.com>
Closes #15675
2023-12-20 14:17:14 -08:00
..
ia32 Use .section .rodata instead of .rodata on FreeBSD 2023-02-24 16:45:48 -08:00
acl_impl.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
acl.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
atomic.h FreeBSD: Reduce divergence from in-tree sources 2023-10-09 13:27:18 -07:00
byteorder.h Reduce false positives from Static Analyzers 2022-09-30 15:30:12 -07:00
callb.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
ccompat.h FreeBSD: Reduce divergence from in-tree sources 2023-10-09 13:27:18 -07:00
ccompile.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
cmn_err.h spl: cmn_err_once() should be usable in brace-less if else statements 2023-03-15 11:13:25 -07:00
condvar.h FreeBSD: make adjustments for the standalone environment 2020-10-13 21:05:49 -07:00
cred.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
ctype.h FreeBSD: Reduce divergence from in-tree sources 2023-10-09 13:27:18 -07:00
debug.h Add VERIFY0P() and ASSERT0P() macros. 2023-09-19 17:21:55 -07:00
dirent.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
disp.h Cleanup: Use OpenSolaris functions to call scheduler 2022-09-12 09:55:37 -07:00
dkio.h freebsd: trim dkio.h to the minimum 2022-11-07 15:55:33 -08:00
fcntl.h FreeBSD: fix HEAD build, conditionally remove FDSYNC defines 2021-01-23 15:39:55 -08:00
file.h Rename refcount.h to zfs_refcount.h 2020-07-29 16:35:33 -07:00
freebsd_rwlock.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
idmap.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
inttypes.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
isa_defs.h freebsd: simplify MD isa_defs.h 2022-11-07 15:55:37 -08:00
kmem_cache.h FreeBSD: make adjustments for the standalone environment 2020-10-13 21:05:49 -07:00
kmem.h Use __attribute__((malloc)) on memory allocation functions 2023-05-26 15:47:52 -07:00
kstat.h Cleanup: Switch to strlcpy from strncpy 2022-09-27 16:35:29 -07:00
list_impl.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
list.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
lock.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
misc.h Remove hw_serial, ddi_strtoul() 2022-05-13 10:15:31 -07:00
mod_os.h spa: make read/write queues configurable 2023-12-20 14:17:14 -08:00
mode.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
mount.h freebsd: changes necessary to coexist with dtrace in tree 2020-07-01 09:10:08 -07:00
mutex.h Add mutex_enter_interruptible() for interruptible sleeping IOCTLs 2023-10-26 09:17:40 -07:00
param.h Refactor ccompile.h to not include system headers 2020-07-25 20:09:50 -07:00
policy.h Share zfs_fsync, zfs_read, zfs_write, et al between Linux and FreeBSD 2020-10-21 14:08:06 -07:00
proc.h FreeBSD: make adjustments for the standalone environment 2020-10-13 21:05:49 -07:00
processor.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
procfs_list.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
random.h FreeBSD: fix compilation of FreeBSD world after 29274c9f6 2021-06-25 10:28:51 -07:00
rwlock.h spl: Don't check FreeBSD rwlocks for double initialization (#13019) 2022-01-31 10:58:45 -08:00
sdt.h Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
sid.h Fix ACL checks for NFS kernel server 2022-03-18 06:47:57 -06:00
sig.h FreeBSD: make adjustments for the standalone environment 2020-10-13 21:05:49 -07:00
simd_aarch64.h module: freebsd: fix aarch64 fpu handling 2023-04-10 12:40:18 -07:00
simd_arm.h Miscellaneous FreBSD compilation bugfixes 2023-04-06 10:35:02 -07:00
simd_powerpc.h powerpc64: Support ELFv2 asm on Big Endian 2023-04-27 12:49:21 -07:00
simd_x86.h Miscellaneous FreBSD compilation bugfixes 2023-04-06 10:35:02 -07:00
simd.h Add SHA2 SIMD feature tests for FreeBSD 2023-03-02 13:51:56 -08:00
spl_condvar.h FreeBSD: Reduce divergence from in-tree sources 2023-10-09 13:27:18 -07:00
string.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
sunddi.h Remove hw_serial, ddi_strtoul() 2022-05-13 10:15:31 -07:00
sysmacros.h freebsd: simplify MD isa_defs.h 2022-11-07 15:55:37 -08:00
systeminfo.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
systm.h Refactor ccompile.h to not include system headers 2020-07-25 20:09:50 -07:00
taskq.h Unbreak FreeBSD world build after 3bd4df384 2023-11-08 16:29:34 -08:00
thread.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
time.h Use uint64_t instead of u_int64_t 2023-11-30 10:36:33 -08:00
timer.h Cleanup: Use OpenSolaris functions to call scheduler 2022-09-12 09:55:37 -07:00
trace_zfs.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
trace.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
types32.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
types.h Linux 6.3 compat: idmapped mount API changes 2023-04-10 14:15:36 -07:00
uio.h dmu: Allow buffer fills to fail 2023-12-15 09:51:41 -08:00
uuid.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
vfs.h FreeBSD: Fix ZFS so that snapshots under .zfs/snapshot are NFS visible 2023-11-27 16:31:03 -08:00
vm.h Use new FreeBSD API to largely eliminate object locking 2020-04-17 09:30:26 -07:00
vmsystm.h Add FreeBSD support to OpenZFS 2020-04-14 11:36:28 -07:00
vnode_impl.h FreeBSD: Cleanup zfs_readdir() 2022-09-20 14:50:16 -07:00
vnode.h FreeBSD: Fix the build on FreeBSD 12 2023-11-27 12:58:03 -08:00
wmsum.h Introduce write-mostly sums 2021-05-27 14:27:29 -06:00
zmod.h Replace dead opensolaris.org license link 2022-07-11 14:16:13 -07:00
zone.h FreeBSD: Simplify INGLOBALZONE 2020-08-31 19:43:08 -07:00